Apparatus for visualizing amount of correction, control method thereof, and program

The correction amount visualization device quantitatively evaluates correction parameters for color matching, addressing image quality concerns by displaying correction amounts and distinguishing between corrected and uncorrected colors.

JP2024156458AInactive Publication Date: 2024-11-06CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023070936
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-24
Publication Date
2024-11-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing techniques for color matching between cameras fail to quantitatively evaluate the validity of correction lookup tables, leading to potential image quality deterioration due to color distortion outside the dynamic range of the color chart.

Method used

A correction amount visualization device that calculates and displays the correction amount of colors not included in the color chart, using reference and target camera information to generate a warning image showing colors within a predetermined correction range.

Benefits of technology

Enables quantitative evaluation of correction parameters, ensuring appropriate color matching and preventing image quality issues by visually distinguishing between corrected and uncorrected colors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024156458000001_ABST
    Figure 2024156458000001_ABST
Patent Text Reader

Abstract

To provide a correction amount visualization apparatus, a control method thereof, and a program, with which the validity of a correction parameter to be used in color adjustment between cameras can be confirmed through quantitative evaluation.SOLUTION: A correction amount visualization apparatus 103 is configured to visualize the amount of correction of a color corrected by applying a correction lookup table, the correction amount visualization apparatus including a warning image generation unit 710. The correction lookup table is calculated based on RGB values obtained by a reference camera 101a and a target camera 101b imaging a color chart 104, to correct a color not included in the color chart 104. The warning image generation unit 710 receives an input of an evaluation image and outputs a warning image, as an output image, the warning image representing a color whose amount of correction with the correction lookup table is included or not included in a predetermined correction amount range, out of colors included in the evaluation images, in a display mode according to the correction amount range.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a correction amount visualization device, a control method thereof, and a program. [Background technology]

[0002] Conventionally, when photographing is performed using multiple cameras, color matching between the multiple cameras is performed, for example, by color matching software prior to the photographing. In the color matching, a camera serving as a reference for color matching (hereinafter referred to as a "reference camera") and a camera to be subjected to color matching (hereinafter referred to as a "target camera") are arranged in front of a color chart arranged in the photographing environment. Then, based on each image of the color chart acquired by photographing the reference camera and the target camera, correction parameters are generated for matching the color of the target camera to the color of the reference camera. Furthermore, the correction parameters thus generated are applied to the target camera, thereby performing color matching between the reference camera and the target camera. The correction parameters are generated, for example, by a correction lookup table (hereinafter referred to as a "correction LUT") which is a table.

[0003] However, depending on the lighting environment, the camera settings, etc., the dynamic range of the captured color chart may relatively decrease and become narrower than the dynamic range of the camera. Therefore, when the above-mentioned color matching is performed in this case, image quality degradation such as color bending is likely to occur for colors outside the dynamic range of the color chart. Therefore, when a correction LUT is generated based on each image of the color chart acquired by shooting with a reference camera or a target camera, it is important to visualize and confirm the correction amount by applying the correction LUT. In this regard, Patent Document 1 discloses a technology for visualizing the correction strength of the knee correction applied to an input image signal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-144295 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology disclosed in Patent Document 1 visualizes the correction intensity only for the colors included in the input image signal. Therefore, it is difficult for the technology disclosed in Patent Document 1 to visualize the correction amount by application of the correction LUT for all colors, and it is also difficult to visualize the correction amount by application of the correction LUT only for those within a predetermined range. Therefore, the technology disclosed in Patent Document 1 has a problem in that it is not suitable for confirming the validity of the correction LUT by quantitative evaluation.

[0006] The present invention has been made in view of the above problems, and has an object to provide a correction amount visualization device, a control method thereof, and a program for enabling confirmation of the validity of correction parameters used in color matching between cameras through quantitative evaluation. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the present invention provides a correction amount visualization device that visualizes the correction amount of a color corrected by applying a correction parameter, wherein the correction parameter is calculated based on reference color information and target color information obtained by a reference imaging device and a target imaging device photographing the same color chart, thereby making it possible to correct a color not included in the color chart, and is characterized in that the device comprises: an input means for inputting an evaluation image; a generation means for generating as an output image a warning image showing, among the colors included in the evaluation image, colors whose correction amount when corrected by applying the correction parameter is included or not included in a predetermined correction amount range, in a display form corresponding to the correction amount range; and an output means for outputting the output image. Effect of the Invention

[0008] According to the present invention, the validity of correction parameters used in color matching between cameras can be confirmed by quantitative evaluation. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration example of a correction amount visualization system. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of a correction LUT generating device. [Diagram 3] FIG. 13 is a diagram showing an example of an extraction range of a color patch arranged on a color chart. [Figure 4] FIG. 11 is a diagram showing an example of RGB values ​​of color patches of a photographed color chart. [Diagram 5] FIG. 13 is a diagram illustrating an example of input and output values ​​of an approximation equation using a quadratic function. [Figure 6] FIG. 13 is a diagram showing an example of a 3DLUT which is a correction LUT. [Figure 7] 1 is a block diagram showing an example of the configuration of a correction amount visualization device; [Figure 8] 1 is a diagram showing an example of an image generated by an image generating unit of the correction amount visualization device; [Figure 9] 10 is a flowchart showing a process flow when a warning image or the like is generated by the correction amount visualization device. [Figure 10] FIG. 13 is a diagram showing an example of a table in which a correction amount range and the like are set. [Figure 11] 11 is a diagram showing an example of a UI screen generated by a control unit of the correction amount visualization device. FIG. [Figure 12] 11 is a diagram showing an example of a UI screen generated by a control unit of the correction amount visualization device. FIG. [Figure 13] 11 is a diagram showing an example of a UI screen generated by a control unit of the correction amount visualization device. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the present embodiments. For example, each part constituting the present invention can be replaced with any configuration that can perform the same function. In addition, any configuration may be added. In addition, any two or more configurations (features) of the present embodiments can be combined. Hereinafter, a correction amount visualization device and a control method thereof according to the present embodiment will be described with reference to the drawings.

[0011] (Explanation of the correction amount visualization system) FIG. 1 is a block diagram showing a configuration example of a correction amount visualization system 100. As shown in FIG. 1, the correction amount visualization system 100 includes an imaging device 101, a correction LUT generation device 102, and a correction amount visualization device 103 (correction amount visualization device). The imaging device 101 is composed of a reference camera 101a (reference imaging device) and a target camera 101b (target imaging device). The reference camera 101a and the target camera 101b output the captured images to the correction LUT generation device 102 via video lines. Note that, when matching colors between the cameras, the reference camera 101a and the target camera 101b output the respective images captured while being arranged in front of a color chart 104 for color matching to the correction LUT generation device 102.

[0012] The correction LUT generating device 102 generates a correction LUT (correction parameters) for color matching based on each image input from the reference camera 101a and the target camera 101b. The correction amount visualizing device 103 visualizes the amount of correction by applying the correction LUT generated by the correction LUT generating device 102. Note that images corrected by applying the correction LUT include, for example, an image generated inside the correction amount visualizing device 103 and an image captured from an image input from the target camera 101b to the correction amount visualizing device 103. In the following, an image to which the correction LUT generated by the correction LUT generating device 102 is applied may be referred to as an "evaluation image."

[0013] (Explanation of correction LUT generating device 102) 2 is a block diagram showing an example of the configuration of the correction LUT generating device 102. As shown in FIG. 2, the correction LUT generating device 102 includes video receiving units 201a and 201b, video capturing units 202a and 202b, a control unit 203, an operation unit 204, a correction LUT generating unit 205, an output unit 206, and a display unit 207. The video receiving unit 201a receives a video from the reference camera 101a and outputs the received video to the video capturing unit 202a. Similarly, the video receiving unit 201b receives a video from the target camera 101b and outputs the received video to the video capturing unit 202b. The video capturing unit 202a captures the video input from the video receiving unit 201a, that is, the video of the reference camera 101a, generates an image, and outputs the generated image to the control unit 203. Similarly, the video capture unit 202b captures the video input from the video receiving unit 201b, that is, the video of the target camera 101b, generates an image, and outputs the generated image to the control unit 203. Specifically, the video capture units 202a and 202b generate an image for one frame of the video input from the video receiving units 201a and 201b, for example, and store the generated image in a frame memory or the like and output it.

[0014] The control unit 203 is a computer that performs overall control of the correction LUT generating device 102. Specifically, the control unit 203 generates a display image in which, for example, an image of the reference camera 101a input from the video capture unit 202a and an image of the target camera 101b input from the video capture unit 202b are arranged side by side. The control unit 203 also superimposes a rectangle on the display image based on area information of each color patch input from the operation unit 204. The area information of each color patch will be described together with the operation unit 204, which will be described later. The control unit 203 also generates a warning or message, and superimposes the generated warning or message on the display image. The control unit 203 also outputs the display image and the like generated in this way to the display unit 207. Furthermore, when generating the correction LUT, the control unit 203 outputs the image of the reference camera 101a input from the video capture unit 202a and the image of the target camera 101b input from the video capture unit 202b to the correction LUT generation unit 205. Furthermore, when generating the correction LUT, the control unit 203 outputs area information of each color patch input from the operation unit 204 to the correction LUT generation unit 205.

[0015] The operation unit 204 has an operation device such as a mouse and a keyboard. The operation unit 204 accepts an operation from a user on the operation device and outputs information related to the operation to the control unit 203. Specifically, for example, when a user extracts the inside of a color patch in an image with a mouse or the like, the operation unit 204 outputs information including the coordinates of the start point and end point of the extracted rectangle to the control unit 203 as area information of the color patch indicating the range extracted by the rectangle. The correction LUT generation unit 205 uses the area information of each color patch input from the control unit 203 to generate a correction LUT for matching the color of the target camera 101b to the color of the reference camera 101a, and outputs the generated correction LUT to the output unit 206. That is, the correction LUT generation unit 205 generates and outputs a correction LUT based on the extraction range of the color patch in the image of the reference camera 101a and the image of the target camera 101b specified by the area information of each color patch.

[0016] FIG. 3 is a diagram showing an example of extraction ranges 325-348 of color patches 301-324 arranged on the color chart 104. The correction LUT generation unit 205 calculates averaged data for each of the color patches 301-324 by averaging the RGB values ​​of the respective extraction ranges 325-348 for the color patches 301-324 in FIG. 3. In addition, since the actual captured image also contains colors other than the color patches 301-324, the correction LUT generation unit 205 estimates colors other than the color patches 301-324 by an approximation formula obtained as follows. For example, the correction LUT generation unit 205 obtains the approximation formula by determining coefficients α, β, and γ of the following quadratic function based on the averaged data of the achromatic color patches 319-324 included in the color chart 104.

[0017]

number

[0018] FIG. 4 is a diagram showing an example of RGB values ​​of color patches 301-324 of a photographed color chart 104. FIG. 4(A) is a diagram showing an example of RGB values ​​of color patches 301-324 of a color chart 104 photographed by a reference camera 101a. FIG. 4(B) is a diagram showing an example of RGB values ​​of color patches 301-324 of a color chart 104 photographed by a target camera 101b. The above coefficients α, β, and γ are determined by the least squares method using averaged data of achromatic color patches 319-324 shown in FIG. 3, for example. This point will be specifically described below.

[0019] The gradation values ​​of the achromatic color patches 319-324 are denoted by xi (i=319-324). If the image was taken by the reference camera 101a, the averaged data of the color patches 319-324 of that image is denoted by yi (i=319-324). Similarly, if the image was taken by the target camera 101b, the averaged data of the color patches 319-324 of that image is also denoted by yi (i=319-324). In either case, the coefficients α, β, and γ are found by the following determinant:

[0020]

number

[0021] Here, the adjustment values ​​xi of the color patches 319 to 324 are x319=2304, x320=2048, x321=1536, x322=1024, x323=512, and x324=256, respectively. The averaged data yi of the color patches 319 to 324 photographed by the reference camera 101a is the average value of the RGB values ​​corresponding to the patch numbers 319 to 324 in Fig. 4(A). On the other hand, the averaged data yi of the color patches 319 to 324 photographed by the target camera 101b is the average value of the RGB values ​​corresponding to the patch numbers 319 to 324 in Fig. 4(B). In this manner, an approximation equation using a quadratic function for the reference camera 101a and an approximation equation using a quadratic function for the target camera 101b are obtained. If there are multiple color patches of R, G, and B single colors on the color chart 104, an approximation formula using a quadratic function for each of R, G, and B may be obtained. Also, the approximation formula is not limited to the curve approximation using the quadratic function described above, and may be obtained using other curve approximations (such as a cubic or higher order multidimensional function or logarithmic approximation) or linear approximation.

[0022] FIG. 5 is a diagram showing an example of input and output values ​​of the above approximation formula using a quadratic function. As shown in FIG. 5, in the case of a 3DLUT in which the correction LUT has 17×17×17 grid points, the combined RGB values ​​(each 12-bit integer) for the grid points are substituted into the input value x of the above approximation formula, respectively, to obtain an output value corresponding to each grid point. FIG. 6 is a diagram showing an example of a 3DLUT which is a correction LUT. As shown in FIG. 6, the output value of the correction LUT (3DLUT) generated by the correction LUT generating unit 205 is calculated by the difference between the output value of the above approximation formula for the reference camera 101a and the output value of the above approximation formula for the target camera 101b. In this way, the correction LUT (3DLUT) is generated so as to be able to correct all colors including colors not included in the color patches 301 to 324 based on the RGB values ​​(reference color information) shown in FIG. 4(A) and the RGB values ​​(target color information) shown in FIG. 4(B).

[0023] Return to FIG. 2. The output unit 206 inputs the correction LUT from the correction LUT generation unit 205, and outputs the input correction LUT to a file in a format for importing to the target camera 101b or the correction amount visualization device 103. The user copies the output file to a portable medium, and applies the correction LUT to the target camera 101b via the portable medium, thereby performing color matching between the cameras. However, when the target camera 101b and the correction LUT generation device 102 are connected via a LAN or the like, the output unit 206 may directly transfer the correction LUT to the target camera 101b. This also applies to the correction amount visualization device 103. The display unit 207 displays the display image input from the control unit 203, etc.

[0024] (Explanation of the correction amount visualization device 103) FIG. 7 is a block diagram showing a configuration example of the correction amount visualization device 103. As shown in FIG. 7, the correction amount visualization device 103 has a control unit 701, an operation unit 702, an input unit 703, a storage unit 704, a video receiving unit 705, and a video capture unit 706. The correction amount visualization device 103 further has an image generation unit 707, a switching unit 708, an image correction unit 709, a warning image generation unit 710, and a display unit 711. The control unit 701 is a computer that performs the overall control of the correction amount visualization device 103. Specifically, the control unit 701 generates, for example, a UI screen 1100 shown in FIG. 11 to FIG. 13 described later, and outputs the generated UI screen 1100 to the display unit 711. The UI screen 1100 will be described later. Furthermore, the control unit 701 controls the video receiving unit 705, the image generating unit 707, the switching unit 708, the image correcting unit 709, and the warning image generating unit 710 according to the operation information input from the operation unit 702 and the screen state of the UI screen 1100. Furthermore, the control unit 701 receives a file in which various data is stored from the input unit 703, and transmits the received file to the storage unit 704. Note that the correction amount visualization device 103 stores in advance a program for causing the control unit 701 to execute each unit and each means (a control method of the correction amount visualization device) of the correction amount visualization device 103.

[0025] The operation unit 702 has an operation device such as a mouse or a keyboard, and outputs operation information of the operation device operated by the user to the control unit 701. Specifically, for example, when the operation device operated by the user is a keyboard, the operation unit 702 outputs a key event indicating that a cursor key, a numeric key, or the like of the keyboard has been pressed to the control unit 701 as operation information. The input unit 703 receives a file in which various data is stored from the outside of the correction amount visualization device 103. The file received by the input unit 703 includes, for example, a file in which various data such as an image or a correction LUT generated by the correction LUT generating device 102 is stored. The holding unit 704 receives various data from the control unit 701 and holds the input various data. The various data input from the control unit 701 to the holding unit 704 includes, for example, a file in which various data such as an image or a correction LUT is stored (that is, a file received by the input unit 703), data indicating the screen state of the UI screen 1100, and the like.

[0026] The video receiving unit 705 receives video from the target camera 101b and outputs the received video to the video capturing unit 706. However, the video receiving unit 705 can also receive video from a camera other than the target camera 101b. The video capturing unit 706 generates an image by capturing the video input from the video receiving unit 705 and outputs the generated image to the switching unit 708. Specifically, the video capturing unit 706 stores, for example, one frame of the video of the target camera 101b input from the video receiving unit 705 in a frame memory or the like and outputs it.

[0027] The image generating unit 707 generates an image based on the evaluation image conditions instructed by the control unit 701. The method of setting the evaluation image conditions will be described later together with the description of Figs. 11 to 13. The types of evaluation image conditions include, for example, hue, saturation, brightness, etc., but are not limited to these as long as they are generation conditions for an image that can be used as an evaluation image. When the same hue value is set as the evaluation image condition, the image generating unit 707 generates a color map image of the same hue value, for example, according to each formula described below. Specifically, when the number of horizontal pixels of the generated image is pw, the number of vertical pixels is ph, and the coordinate value [x, y] of the lower left end is [0, 0], the image generating unit 707 first calculates the brightness value V and the saturation value S based on the coordinate value of each pixel using each formula below.

[0028]

number

[0029] Next, the image generating unit 707 calculates Rh, Gh, and Bh, which are RGB values ​​reflecting the hue value H, using the following formulas, based on the hue value H (0≦H<360) set as an evaluation image condition.

[0030]

number

[0031] Next, the image generating unit 707 calculates Rhv, Ghv, and Bhv, which are RGB values ​​reflecting the hue value H and the luminance value V, based on the above Rh, Gh, and Bh, using the following formulas.

[0032]

number

[0033] Finally, the image generation unit 707 calculates Rhsv, Ghsv, and Bhsv (each 12-bit integer) which are RGB values ​​reflecting the hue value H, saturation value S, and lightness value V, based on the above Rhv, Ghv, Bhv, and saturation value S, using the following formulas. Note that in the following formulas, MAX is a function that calculates the maximum value, and INT is a function that converts into an integer value.

[0034]

number

[0035] The image generating unit 707 generates an image as shown in FIG. 8, for example, by using the above formulas. The image shown in FIG. 8 is a color map image of the same hue value, with brightness in the vertical direction and saturation in the horizontal direction. Note that the image generated by the image generating unit 707 is not limited to a color map image of the same hue value. For example, when the same saturation value is set as the evaluation image condition, the image generating unit 707 generates a color map image of the same saturation value, and when the same brightness value is set as the evaluation image condition, the image generating unit 707 generates a color map image of the same brightness value. Based on an instruction from the control unit 701, the switching unit 708 selects one of the image input from the video capture unit 706, the image input from the image generating unit 707, and the image held in the holding unit 704. Furthermore, the switching unit 708 outputs the selected image (hereinafter referred to as the "selected image") to the image correcting unit 709 and the warning image generating unit 710. The image held in the holding unit 704 is input to the switching unit 708 via the control unit 701 .

[0036] The image correction unit 709 applies the correction LUT to the selected image input from the switching unit 708. Therefore, the selected image of the switching unit 708 corresponds to an evaluation image. The correction LUT held in the holding unit 704 is input to the image correction unit 709 via the control unit 701 as the correction LUT to be applied to the selected image input from the switching unit 708. The image correction unit 709 outputs an image after applying the correction LUT to the selected image input from the switching unit 708 (hereinafter referred to as a "corrected image") to the warning image generation unit 710. In the following, the selected image output from the switching unit 708 to the warning image generation unit 710 is referred to as a "pre-correction image". The warning image generation unit 710 generates a warning image based on the pre-correction image and the post-correction image in accordance with an instruction from the control unit 701. At this time, the warning image generation unit 710 receives the pre-correction image from the switching unit 708 and the post-correction image from the image correction unit 709. The display unit 711 displays the UI screen 1100 input from the control unit 701. The display unit 711 displays the UI screen 1100 input from the control unit 701. The UI screen 1100 is a screen for displaying a user interface (UI) image.

[0037] (Explanation of the flow of generating warning images, etc.) FIG. 9 is a flowchart showing a process flow when a warning image or the like is generated by the correction amount visualization device 103. A program based on the flowchart shown in FIG. 9 is executed by the control unit 701 of the correction amount visualization device 103. As a result, each process of the flowchart shown in FIG. 9 is performed by the warning image generation unit 710 based on an instruction from the control unit 701. In step S901, a pre-correction image is input from the switching unit 708 to the warning image generation unit 710 (input means) (input step). Furthermore, a post-correction image is input from the image correction unit 709 to the warning image generation unit 710. Note that the pre-correction image input from the switching unit 708 is either an image input from the video capture unit 706, an image input from the image generation unit 707, or an image held in the holding unit 704, as described above, and corresponds to an evaluation image.

[0038] In step S902, the warning image generating unit 710 repeats the processes of steps S902 to S918 for the number of vertical pixels of the image input in step S901. In step S903, the warning image generating unit 710 repeats the processes of steps S903 to S917 for the number of horizontal pixels of the image input in step S901. In this way, in the flowchart shown in Fig. 9, the processes of steps S904 to S916 are repeated for pixels at predetermined positions identified by steps S902 and S903 in the pre-corrected image and the post-corrected image.

[0039] In step S904, the warning image generating unit 710 determines whether the correction amount warning display is enabled. Note that, for example, when the UI screen 1100 is displayed on the display unit 711, the user operates an operation part 1141 (described later) to switch between enabled and disabled states of the correction amount warning display. If the warning image generating unit 710 determines that the correction amount warning display is enabled, the process proceeds to step S905. On the other hand, if the warning image generating unit 710 determines that the correction amount warning display is not enabled, the process proceeds to step S914.

[0040] In step S905, the warning image generating unit 710 acquires RGB values ​​of pixels at predetermined positions from both the pre-correction image input from the switching unit 708 and the post-correction image input from the image correcting unit 709. In step S906, the warning image generating unit 710 judges whether the color of the pre-correction image is within a predetermined color range. This judgment is made based on the RGB values ​​of the pixels at the predetermined positions acquired from the pre-correction image in step S905. Here, the color range refers to a range of hue, brightness, saturation, etc., and is set by the user operating an operation part 1144 described later when the UI screen 1100 is displayed on the display unit 711, for example.

[0041] Moreover, the color of the pre-corrected image refers to, for example, a hue value (H) when a hue range is set as the color range, a luminance value (V) when a luminance range is set as the color range, and a saturation value (S) when a saturation range is set as the color range. When a hue range is set as the color range, the warning image generating unit 710 converts the RGB values ​​(r, g, b) of the pre-corrected image acquired in step S905 into a hue value (H) according to the following formulas. Furthermore, the warning image generating unit 710 determines whether the converted hue value (H) is within the set hue range. In the following formulas, MAX is a function that calculates the maximum value, and MIN is a function that calculates the minimum value.

[0042]

number

[0043] Furthermore, when a lightness range or a saturation range is set as the color range, the warning image generating unit 710 converts the RGB values ​​(r, g, b) of the pre-corrected image acquired in step S905 into a lightness value (V) or a saturation value (S) according to the following formulas. Furthermore, the warning image generating unit 710 determines whether the converted lightness value (V) or saturation value (S) is within the set lightness range or saturation range. In the following formulas, MAX is a function that calculates the maximum value, and MIN is a function that calculates the minimum value.

[0044]

number

[0045] In this way, the warning image generating unit 710 determines whether the color of the precorrected image is within the predetermined color range. If the warning image generating unit 710 determines that the color of the precorrected image is within the predetermined color range, the process proceeds to step S907. On the other hand, if the warning image generating unit 710 determines that the color of the precorrected image is not within the predetermined color range, the process proceeds to step S914.

[0046] In steps S907 to S913, a warning is displayed for pixels in the corrected image that have been corrected with a correction amount within a predetermined range. As a result, the warning image generating unit 710 can limit pixels included in the evaluation image that are to be displayed with a warning to within a predetermined color range (for example, within a hue range) as in image 1110 shown in Fig. 13(B) described later by the determination process in step S906. Note that image 1110 shown in Fig. 13(A) is an example of a warning display (shaded area) when the hue range is not limited, and image 1110 shown in Fig. 13(B) is an example of a warning display (shaded area) when the hue range is limited.

[0047] In step S907, the warning image generating unit 710 calculates the amount of correction based on the RGB values ​​of the pre-corrected image and the RGB values ​​of the corrected image acquired in step S905. Specifically, when calculating the amount of correction of hue, for example, the warning image generating unit 710 converts the RGB values ​​of a pixel at a predetermined position in the pre-corrected image and the RGB values ​​of a pixel at a predetermined position in the corrected image into hue values ​​according to the formulas explained in step S906. Furthermore, the warning image generating unit 710 calculates the difference Hdiff in the hue values ​​as the amount of correction according to the following formula. In the following formula, ABS is a function that calculates an absolute value. Furthermore, Horg is the hue value of the pre-corrected image, and Hcor is the hue value of the corrected image.

[0048]

number

[0049] The warning image generating unit 710 calculates the amount of correction of brightness or saturation in the same manner. In step S908, the warning image generating unit 710 determines whether the amount of correction calculated in step S907 is within a predetermined range of correction amounts. The correction amount range is set by the user operating an operation part 1142 (described later) when the UI screen 1100 is displayed on the display unit 711, for example. At that time, the control unit 701 generates a table in which the correction amount range is set, for example, as shown in FIG. 10(A) or FIG. 10(B), based on the UI operation on the UI screen 1100. The user can set at least one or more correction amount ranges, as shown in the table shown in FIG. 10(A) or FIG. 10(B).

[0050] In the table shown in FIG. 10A, three correction amount ranges are set for hue, which is one of the correction amount types. The first correction amount range is a range in which the lower limit of the correction amount is 10 or more and the upper limit of the correction amount is less than 20. The second correction amount range is a range in which the lower limit of the correction amount is 20 or more and the upper limit of the correction amount is less than 30. The third correction amount range is a range in which the correction amount is 30 or more. The RGB value of [4095, 0, 0] is associated as an output value with the first correction amount range. The RGB value of [4095, 2048, 0] is associated as an output value with the second correction amount range. The RGB value of [4095, 3072, 0] is associated as an output value with the third correction amount range. Hereinafter, the information on the correction amount ranges and the like shown in the table of FIG. 10A will be referred to as "setting information of FIG. 10A". In the table shown in Fig. 10(A), the correction amount type is hue, but even if the correction amount type is lightness or saturation, the control unit 701 can similarly generate a table in which one or more correction amount ranges etc. are set. Also, the table shown in Fig. 10(B) will be described later.

[0051] 10A, for example, the warning image generating unit 710 determines that the correction amount calculated in step S907 is within a predetermined correction amount range if the difference Hdiff in the hue values ​​is 10 or more. In this way, when the warning image generating unit 710 determines that the correction amount calculated in step S907 is within the predetermined correction amount range, the process proceeds to step S909. On the other hand, when the warning image generating unit 710 determines that the correction amount calculated in step S907 is not within the predetermined correction amount range, the process proceeds to step S914.

[0052] In step S909, the warning image generating unit 710 determines whether or not a warning display according to the dynamic range of the color chart 104 (hereinafter referred to as "D range-specific display") is enabled. Note that the D range-specific display can be switched between enabled and disabled by the user operating an operation part 1143 (described later) when the UI screen 1100 is displayed on the display unit 711, for example. If the warning image generating unit 710 determines that the D range-specific display is enabled, the process proceeds to step S910. On the other hand, if the warning image generating unit 710 determines that the D range-specific display is not enabled, the process proceeds to step S911.

[0053] In step S910, the warning image generating unit 710 judges whether the color of the pre-correction image is within the dynamic range of the color chart 104. Hereinafter, the dynamic range is referred to as the "D range." Specifically, for example, when the brightness (maximum value of RGB value) of a predetermined position of the pre-correction image is equal to or greater than the minimum value and equal to or less than the maximum value of the brightness (maximum value of RGB value) of the color chart 104, the color of the pre-correction image is judged to be within the D range of the color chart 104. When the warning image generating unit 710 judges that the color of the pre-correction image is within the D range of the color chart 104, the process proceeds to step S912. On the other hand, when the warning image generating unit 710 judges that the color of the pre-correction image is not within the D range of the color chart 104, the process proceeds to step S913.

[0054] The warning image generating unit 710 can also perform this determination using saturation or hue instead of brightness. The warning image generating unit 710 can also calculate the D-range of the color chart 104 based on the color information of the color chart 104 input from the correction LUT generating device 102 via the input unit 703. For example, when the RGB values ​​(target color information) shown in FIG. 4(B) are input as the color information of the color chart 104, the D-range of the color chart 104 is 256 to 2544 (12-bit integer). However, the color information of the color chart 104 is obtained from the photographing data of the target camera 101b.

[0055] In step S911, the warning image generating unit 710 (generating means) sets the RGB value corresponding to the correction amount calculated in step S907 as the display form of the predetermined position of the output image (warning image) (generating step). After that, the process proceeds to step S917. Note that the warning image generating unit 710 can determine the RGB value corresponding to the correction amount based on, for example, the setting information of FIG. 10(A). In this case, if the correction amount calculated in step S907 is 10 or more and less than 20, the RGB value of [4095, 0, 0] linked as the output value to the correction amount range of 10 or more and less than 20 is set as the display form of the predetermined position of the output image. Also, if the correction amount calculated in step S907 is 20 or more and less than 30, the RGB value of [4095, 2048, 0] linked as the output value to the correction amount range of 20 or more and less than 30 is set as the display form of the predetermined position of the output image. Furthermore, if the correction amount calculated in step S907 is 30 or more, the RGB values ​​of [4095, 3027, 0] associated as output values ​​with the correction amount range of 30 or more are set as the display form at a predetermined position on the output image.

[0056] An image 1110 shown in FIG. 11(A) is an image when the amount of correction is not visualized, and an image 1110 shown in FIG. 11(B) is an image when the amount of correction is visualized. In the image 1110 shown in FIG. 11(B), the diagonal line portion and the vertical line portion indicate pixels converted into a specific color by setting an RGB value according to the amount of correction as the display form of a predetermined position of the output image in step S911. In this way, in step S911, an RGB value according to the amount of correction is set as the display form of a predetermined position of the output image, so that the amount of correction applied to the image can be visualized as in the image 1110 shown in FIG. 11(B). The visualization of the amount of correction applied to the image is not limited to the visualization by conversion to a specific color as described above, and may be performed by conversion to another display form such as a zebra pattern.

[0057] In steps S912 and S913, the warning image generating unit 710 (generating means) sets the RGB value according to the correction amount calculated in step S907 and the determination result in step S910 as the display form of the predetermined position of the output image (warning image) (generating step). After that, the process proceeds to step S917. In this setting, the warning image generating unit 710 changes the RGB value set as the display form of the predetermined position of the output image depending on whether the color of the pre-correction image is within the D range of the color chart 104 or outside the D range of the color chart 104. Note that the color of the pre-correction image is the color of the pixel at the predetermined position of the pre-correction image. Specifically, the warning image generating unit 710 changes the RGB value set as the display form of the predetermined position of the output image, for example, as shown in the table in FIG. 10(B).

[0058] In the table shown in FIG. 10B, three correction amount ranges are set, similar to the table shown in FIG. 10A. In addition, the RGB value of [4095, 0, 0] is associated with the first correction amount range as an output value when the color of the pre-correction image is within the D range of the color chart 104. In addition, the RGB value of [0, 0, 4095] is associated with the first correction amount range as an output value when the color of the pre-correction image is outside the D range of the color chart 104. In addition, the RGB value of [4095, 2048, 0] is associated with the second correction amount range as an output value when the color of the pre-correction image is within the D range of the color chart 104. In addition, the RGB value of [0, 2048, 4095] is associated with the second correction amount range as an output value when the color of the pre-correction image is outside the D range of the color chart 104.

[0059] Moreover, the RGB value of [4095, 3072, 0] is associated with the third correction amount range as an output value when the color of the pre-correction image is within the D range of the color chart 104. Furthermore, the RGB value of [0, 3072, 4095] is associated with the third correction amount range as an output value when the color of the pre-correction image is outside the D range of the color chart 104. Hereinafter, information on the correction amount range and the like shown in the table of FIG. 10(B) will be referred to as "setting information of FIG. 10(B)". Note that, in the table shown in FIG. 10(B), the correction amount type is hue, but even when the correction amount type is lightness or saturation, the control unit 701 can generate a table in which one or more correction amount ranges and the like are set in the same manner.

[0060] The warning image generating unit 710 in step S912 sets the output value when the color of the pre-correction image is within the D range of the color chart 104 as the display form of the predetermined position of the output image. At that time, when the warning image generating unit 710 uses the setting information of FIG. 10(B), the RGB value is set as the display form of the predetermined position of the output image as follows. When the calculated correction amount in step S907 is 10 or more and less than 20, the RGB value of [4095, 0, 0] linked to the correction amount range of 10 or more and less than 20 as the output value when the color of the pre-correction image is within the D range of the color chart 104 is set in the output image. When the calculated correction amount in step S907 is 20 or more and less than 30, the RGB value of [4095, 2048, 0] linked to the correction amount range of 20 or more and less than 30 as the output value when the color of the pre-correction image is within the D range of the color chart 104 is set in the output image. If the correction amount calculated in step S907 is 30 or more, the RGB value of [4095, 3072, 0] associated with the correction amount range of 30 or more as the output value when the color of the pre-corrected image is within the D range of the color chart 104 is set in the output image.

[0061] The warning image generating unit 710 in step S913 sets the output value when the color of the pre-correction image is outside the D range of the color chart 104 as the display form of a predetermined position of the output image. At that time, when the warning image generating unit 710 uses the setting information of FIG. 10(B), the RGB value is set as the display form of a predetermined position of the output image as follows. When the calculated correction amount in step S907 is 10 or more and less than 20, the RGB value of [0,0,4095] linked to the correction amount range of 10 or more and less than 20 as the output value when the color of the pre-correction image is outside the D range of the color chart 104 is set in the output image. When the calculated correction amount in step S907 is 20 or more and less than 30, the RGB value of [0,2048,4095] linked to the correction amount range of 20 or more and less than 30 as the output value when the color of the pre-correction image is outside the D range of the color chart 104 is set in the output image. If the correction amount calculated in step S907 is 30 or more, the RGB value of [0, 3072, 4095] associated with the correction amount range of 30 or more as the output value when the color of the pre-corrected image is outside the D range of the color chart 104 is set in the output image.

[0062] Note that an image 1110 shown in FIG. 11B, which will be described later, is an image in the case where the correction amount is visualized without taking into account the D range of the color chart 104. On the other hand, an image 1110 shown in FIG. 12A, which will be described later, is an image in the case where the correction amount is visualized with the D range of the color chart 104 taken into account. In the image 1110 shown in FIG. 12A, the diagonal line portion and the vertical line portion indicate pixels in which the color within the D range of the color chart 104 is converted to a specific color by setting the RGB value according to the correction amount as the display form of the predetermined position of the output image in step S912. In the image 1110 shown in FIG. 12A, the horizontal line portion and the lattice portion indicate pixels in which the color outside the D range of the color chart 104 is converted to a specific color by setting the RGB value according to the correction amount as the display form of the predetermined position of the output image in step S913.

[0063] In this way, in steps S912 and S913, the RGB values ​​according to the correction amount and the inside and outside of the D range of the color chart 104 are set as a display form at a predetermined position of the output image. This makes it possible to visualize the correction amount with colors used to distinguish between inside and outside the D range of the color chart 104, as in the image 1110 shown in Fig. 12(A). Note that the method of visualizing the correction amount with colors used to distinguish between inside and outside the D range of the color chart 104 is not limited to the above-mentioned method of converting to a specific color, and may be performed by converting to another display form such as a zebra pattern.

[0064] In step S914, the warning image generating unit 710 determines whether application of the correction LUT is valid. For example, when the UI screen 1100 is displayed on the display unit 711, the user operates an operation part 1131 described later to switch between valid and invalid application of the correction LUT. If the warning image generating unit 710 determines that application of the correction LUT is valid, the process proceeds to step S915. On the other hand, if the warning image generating unit 710 determines that application of the correction LUT is not valid, the process proceeds to step S916. In step S915, the warning image generating unit 710 (generating means) sets the RGB value of a pixel at a predetermined position of the corrected image to a predetermined position of the output image (warning image). Thereafter, the process proceeds to step S917. In step S916, the warning image generating unit 710 (generating means) sets the RGB value of a pixel at a predetermined position of the pre-corrected image to a predetermined position of the output image (warning image). Thereafter, the process proceeds to step S917.

[0065] Thereby, the warning image generating unit 710 can display, in the output image (warning image), the colors of the evaluation image that are not included in a predetermined color range by the processing of step S915, as the colors of the corrected image. Alternatively, the warning image generating unit 710 can display, in the output image (warning image), the colors of the evaluation image that are not included in a predetermined color range by the processing of step S916. Furthermore, the warning image generating unit 710 can display, in the output image (warning image), the colors of the evaluation image whose correction amount when corrected by applying the correction LUT is not included in a predetermined correction amount range by the processing of step S915. Alternatively, the warning image generating unit 710 can display, in the output image (warning image), the colors of the evaluation image whose correction amount when corrected by applying the correction LUT is not included in a predetermined correction amount range by the processing of step S916. In addition, the warning image generation unit 710 can make the output image generated when the correction amount warning display is not enabled the same image as the post-correction image by processing in step S915, and the same image as the pre-correction image, i.e., the evaluation image, by processing in step S916.

[0066] In step S917, warning image generating unit 710 determines whether the processing of steps S903 to S917 has been repeated for the number of horizontal pixels of the image input in step S901. If warning image generating unit 710 determines that the processing of steps S903 to S917 has been repeated for the number of horizontal pixels of the image input in step S901, the process proceeds to step S918. On the other hand, if warning image generating unit 710 determines that the processing of steps S903 to S917 has not been repeated for the number of horizontal pixels of the image input in step S901, the process returns to step S903. As a result, the processing of steps S903 to S917 is repeatedly performed for the number of horizontal pixels of the image input in step S901.

[0067] In step S918, warning image generating unit 710 determines whether the processing of steps S902 to S918 has been repeated for the number of vertical pixels of the image input in step S901. If warning image generating unit 710 determines that the processing of steps S902 to S918 has been repeated for the number of vertical pixels of the image input in step S901, the process proceeds to step S919. On the other hand, if warning image generating unit 710 determines that the processing of steps S902 to S918 has not been repeated for the number of vertical pixels of the image input in step S901, the process returns to step S902. As a result, the processing of steps S902 to S918 is repeatedly performed for the number of vertical pixels of the image input in step S901.

[0068] In step S919, the warning image generating unit 710 determines whether the display of a frame indicating the D range of the color chart 104 (hereinafter referred to as the "D range frame") is enabled. Note that, for example, when the UI screen 1100 is displayed on the display unit 711, the user operates an operation part 1143 (described later) to switch between enabled and disabled states of the D range frame. If the warning image generating unit 710 determines that the display of the D range frame of the color chart 104 is enabled, the process proceeds to step S920. On the other hand, if the warning image generating unit 710 determines that the display of the D range frame of the color chart 104 is not enabled, the process proceeds to step S921.

[0069] In step S920, the warning image generating unit 710 generates a D-range frame of the color chart 104 and superimposes it on the output image generated by the processing of steps S901 to S918. Specifically, for example, as in step S910, it is assumed that the D-range of the color chart 104 based on the brightness is 256 to 2544 (12-bit integer). In this case, the warning image generating unit 710 superimposes a rectangle 1111 indicating a brightness range of 256 to 2544 on the image 1110 as the D-range frame of the color chart 104, as in the image 1110 shown in FIG. 12(B) described later. Note that the image 1110 on which the rectangle 1111 is superimposed is a color map image of the same hue value with brightness in the vertical direction and saturation in the horizontal direction, similar to the image shown in FIG. 8, and brightness increases from the bottom to the top of the image. In this way, in the image 1110 shown in Fig. 12(B), the inside and outside of the D-range of the color chart 104 are clearly defined by the rectangle 1111 superimposed as the D-range frame. In step S921, the warning image generating unit 710 (output means) outputs the output image generated by the processes of steps S901 to S920 to the control unit 701 (output step). Thereafter, the flowchart shown in Fig. 9 ends.

[0070] (Explanation of UI screen 1100) 11 to 13 are diagrams showing an example of a UI screen 1100 generated by the control unit 701 of the correction amount visualization device 103. As shown in FIG. 11 to FIG. 13, the UI screen 1100 is composed of an image 1110 and operation panels 1120, 1130, and 1140, and can be changed by a user via the operation unit 702. The image 1110 is an output image output from the warning image generation unit 710 of the correction amount visualization device 103 to the control unit 701. Note that the image 1110 in FIG. 11(A) is an image after a correction LUT is applied to a color map image of the same hue value generated by the image generation unit 707. The image 1110 in FIG. 11(B) and each of the images 1110 in FIG. 12(A) and (B) are images displayed by converting the correction amount included in a predetermined correction amount range into a specific color for the image 1110 in FIG. 11(A). The images in Figures 13(A) and (B) are images that are displayed by converting a correction amount included in a predetermined correction amount range into a specific color, for example, an image captured by the target camera 101b.

[0071] Operation panel 1120 has operation parts 1121 to 1124 arranged to allow the user to make settings related to the evaluation image. Operation part 1121 is used to switch the type of evaluation image. Operation part 1121 is a radio button that allows one to specify only one of three items: "Generate under specified conditions," "Input from file," and "Input from external video." Control unit 701 instructs switching unit 708 on the selected image to be output by switching unit 708 to image correction unit 709 and warning image generation unit 710, based on the contents set by operation part 1121.

[0072] An operation for setting evaluation image conditions is performed in the operation part 1122. A pull-down menu for specifying a type, a slide bar for specifying a value, and a text box for displaying a value are arranged in the operation part 1122. For example, when "hue" is specified as a type in the pull-down menu in the operation part 1122, the hue value is adjusted with the slide bar, and the adjustment result of the hue value is displayed in the text box. When "generate under specified conditions" is specified with the radio button of the operation part 1121, the control unit 701 instructs the content set in the operation part 1122 to the image generating unit 707 as the evaluation image conditions. In this way, the user can change the evaluation image conditions with the operation part 1122, and can cause the image generating unit 707 to generate an arbitrary image as the evaluation image.

[0073] The operation part 1123 is used to specify a file in which an image to be used as an evaluation image is stored. The operation part 1123 includes a text box for displaying the file name of the specified file and an "Open" button for acquiring the image of the specified file. When "Input from file" is specified by the radio button of the operation part 1121, the control unit 701 receives a file from the input unit 703 based on the content set by the operation part 1123, and stores the received file in the storage unit 704. When "Input from file" is specified by the radio button of the operation part 1121, the control unit 701 acquires an image of the file stored in the storage unit 704 based on the content set by the operation part 1123, and outputs the image to the switching unit 708.

[0074] Operation part 1124 is used to specify an external video from which an image to be used as an evaluation image is captured. A pull-down menu for specifying an external input terminal to which the external video is input is arranged on operation part 1124. When "Input from external video" is specified with the radio button of operation part 1121, control part 701 instructs video receiving part 705 to switch the video received by video receiving part 705 based on the content set on operation part 1124.

[0075] The operation panel 1130 has operation parts 1131-1132 arranged to allow the user to perform settings related to the correction LUT. The operation part 1131 is used to switch between enabling and disabling the application of the correction LUT. The operation part 1131 has radio buttons arranged to allow the user to specify only one of two items, "ON" and "OFF." In this regard, when "ON" is specified with the radio button of the operation part 1131, the application of the correction LUT is enabled, and when "OFF" is specified with the radio button of the operation part 1131, the application of the correction LUT is disabled. The control unit 701 instructs the warning image generation unit 710 to enable / disable the application of the correction LUT based on the contents set with the operation part 1131.

[0076] An operation of specifying a file in which a correction LUT is stored is performed with the operation part 1132. The operation part 1132 has a text box for displaying the file name of the specified file and an "Open" button for acquiring the correction LUT of the specified file. When "ON" is specified with the radio button of the operation part 1131, the control unit 701 receives a file from the input unit 703 based on the contents set with the operation part 1132, and stores the received file in the storage unit 704. When "ON" is specified with the radio button of the operation part 1131, the control unit 701 acquires the correction LUT of the file stored in the storage unit 704 based on the contents set with the operation part 1132, and outputs the correction LUT to the image correction unit 709.

[0077] The operation panel 1140 has operation parts 1141 to 1144 arranged to allow the user to make settings related to the warning display of the correction amount. The operation part 1141 is used to switch between enabling and disabling the warning display of the correction amount. The operation part 1141 has a radio button arranged to allow the user to specify only one of two items, "ON" and "OFF." In this regard, when "ON" is specified with the radio button of the operation part 1141, the warning display of the correction amount is enabled, and when "OFF" is specified with the radio button of the operation part 1141, the warning display of the correction amount is disabled. The control unit 701 instructs the warning image generating unit 710 to enable / disable the warning display of the correction amount based on the contents set with the operation part 1141.

[0078] The operation part 1142 is used to specify the range of the correction amount that is the target of the warning display. The operation part 1142 has a pull-down menu for specifying a type and a field in which the upper limit / lower limit of a plurality of correction amount ranges can be input. In addition, a pull-down menu for specifying a grid of the display form for each correction amount range is arranged. Note that in Figs. 11 to 13, the grid of the display form represents the color when the correction amount that is the target of the warning display is displayed in false color, but it may represent the grid itself. When "ON" is specified with the radio button of the operation part 1141, the control unit 701 generates, for example, a table shown in Fig. 10(A) based on the contents set with the operation part 1142, and outputs the setting information of Fig. 10(A) to the warning image generating unit 710. However, the output is limited to the case where "OFF" is specified with the operation part 1143 described later. Alternatively, when "ON" is specified by the radio button of the operation part 1141, the control unit 701 generates, for example, a table shown in FIG. 10(B) based on the contents set by the operation part 1142, and outputs the setting information of FIG. 10(B) to the warning image generating unit 710. However, the output is limited to the case where "OFF" is not specified by the operation part 1143 described later. The setting information of FIG. 10(A) or the setting information of FIG. 10(B) includes a correction amount type, a correction amount range, and an output value corresponding to the correction amount range, as shown in FIG. 10. In this way, the user can change the correction amount range by the operation part 1142, so that the correction amount to be displayed as a warning can be changed to an arbitrary correction amount range for the warning image generating unit 710. In addition, the user can change the grid of the display form by the operation part 1142, so that the display form of the warning can be changed to an arbitrary grid (color) for the warning image generating unit 710. In addition, the user can set at least one or more correction amount ranges by the operation part 1142.

[0079] The operation part 1143 is used for performing a setting operation related to visualization of the correction amount according to the D range of the color chart 104 (for example, an operation for switching between enabling / disabling display by D range, etc.). The operation part 1143 has a pull-down menu for switching the visualization method of the D range of the color chart 104 between "ON (frame)", "ON (display form)", "ON (frame + display form)", and "OFF". The control unit 701 instructs the warning image generation unit 710 on the visualization method of the correction amount according to the D range of the color chart 104 based on the content set by the operation part 1143.

[0080] Operation part 1144 is used to specify the color range to which the correction amount warning display is applied. Operation part 1144 has a pull-down menu for specifying the type of color range (hue, brightness, saturation, etc.) and a text box for specifying the color range. Based on the content set in operation part 1144, control unit 701 instructs warning image generating unit 710 on the type of color range and the color range. In this way, the user can use operation part 1144 to limit the colors included in the evaluation image to which the correction amount warning display is applied to those within a desired color range.

[0081] Therefore, a color with a correction amount larger than a predetermined value can be displayed in a special display form, and a color with a correction amount smaller than a predetermined value can be displayed in a special display form. In addition, in the present embodiment, an example in which a range of correction amounts is specified and colors included in the range are displayed in a special display form is described, but it is also possible to set colors that are not included in the specified range to be displayed in a special display form. In this embodiment, it is also possible to display colors included in a correction amount range that is acceptable to the user in a special display form. In this case, the display form of the area where correction that is acceptable to the user has been made is changed, and in this case, too, for convenience, it will be called a "warning screen" or "warning display". In other words, it is sufficient if a display is made that allows the user to identify the degree of the correction amount.

[0082] (summary) As described above, in the correction amount visualization device 103, each process of the flowchart shown in FIG. 9 is performed by the warning image generation unit 710 based on an instruction from the control unit 701. As a result, the display unit 711 displays, for example, the UI screen 1100 shown in FIG. 11(B), FIG. 12(A)(B), or FIG. 13(A)(B). In these UI screens 1100, an image 1110 is displayed that warns of colors, among colors included in the evaluation image, whose correction amount when corrected by applying the correction LUT is included in a predetermined correction amount range, in a display form (false color display) according to the correction amount range. As a result, the correction amount visualization device 103 can confirm the validity of the correction LUT used for color matching between the reference camera 101a and the target camera 101b by quantitative evaluation. In addition, in the correction amount visualization device 103, the user can set at least one or more correction amount ranges by the operation part 1142 of the UI screen 1100. In this regard, if the user sets more correction amount ranges, the validity of the correction LUT can be confirmed by more detailed quantitative evaluation.

[0083] Furthermore, in the correction amount visualization device 103, an image generated by the image generation unit 707 can be used as a selected image of the switching unit 708, that is, as an evaluation image. In this regard, the image generated by the image generation unit 707 is a color map image with the same hue value, the same saturation value, or the same brightness value. Therefore, in this case, the correction amount visualization device 103 can quantitatively evaluate whether the amount of correction by applying the correction LUT is appropriate, even for colors that do not exist in the actual captured image.

[0084] In the correction amount visualization device 103, the selected image of the switching unit 708, that is, the evaluation image, is an input image from the video capture unit 706, an input image from the image generation unit 707, or an input image from the storage unit 704. Therefore, the correction amount visualization device 103 can confirm, by quantitative evaluation, whether the amount of correction by application of the correction LUT is appropriate for the colors contained in various images.

[0085] Furthermore, in the correction amount visualization device 103, among the colors included in the evaluation image, the colors that are displayed in a display form according to the correction amount range in the image 1110 are displayed with distinction between colors that are within the D range of the color chart 104 and colors that are outside the D range. This allows the user to quantitatively evaluate whether the amount of correction achieved by applying the correction LUT is appropriate outside the D range of the color chart 104 where correction errors are likely to occur.

[0086] Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiment, and various modifications and changes are possible within the scope of the gist of the present invention. Parts of the above-mentioned embodiments may be combined as appropriate. For example, the correction amount visualization device 103 may set the upper and lower limits of each correction amount range based on the correction amount within the D range of the color chart 104 or the average value of the correction amount.

[0087] The present invention also includes a case where a software program for implementing the functions of the above-mentioned embodiment is supplied to a system or device having a computer capable of executing the program directly from a recording medium or by using wired / wireless communication, and the program is executed. Therefore, the program code itself that is supplied and installed to a computer in order to realize the functional processing of the present invention by the computer also realizes the present invention. In other words, the computer program itself for implementing the functional processing of the present invention is also included in the present invention. In this case, as long as it has the function of the program, the form of the program does not matter, such as object code, a program executed by an interpreter, script data supplied to an OS, etc. The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory. In addition, as a method of supplying the program, a method in which the computer program forming the present invention is stored in a server on a computer network, and a connected client computer downloads the computer program and programs it is also considered.

[0088] The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0089] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) A correction amount visualization device for visualizing a correction amount of a color corrected by applying a correction parameter, comprising: the correction parameters are calculated based on reference color information and target color information obtained by a reference imaging device and a target imaging device photographing the same color chart, thereby making it possible to correct colors that are not included in the color chart; an input means for inputting an evaluation image; a generating means for generating, as an output image, a warning image which indicates, among colors included in the evaluation image, colors whose correction amount when corrected by applying the correction parameter falls within a predetermined correction amount range or does not fall within the predetermined correction amount range in a display form corresponding to the correction amount range; and an output unit that outputs the output image. (Configuration 2) The correction amount visualization device described in configuration 1, wherein the generation means displays, among the colors included in the evaluation image, colors whose correction amount when corrected by applying the correction parameter is not included in the correction amount range in the warning image, as the color after correction by applying the correction parameter. (Configuration 3) The correction amount visualization device described in Configuration 1, wherein the generation means displays, in the warning image, a color among the colors included in the evaluation image, whose correction amount when corrected by applying the correction parameter is not included in the correction amount range. (Configuration 4) The correction amount visualization device according to any one of configurations 1 to 3, characterized in that an image input from outside or an image satisfying an evaluation image condition is input to the input means as the evaluation image. (Configuration 5) The correction amount visualization device according to configuration 4, wherein the evaluation image condition is one of a same hue value, a same lightness value, and a same saturation value. (Configuration 6) The correction amount visualization device according to configuration 4 or 5, wherein the evaluation image conditions are changeable by a user. (Configuration 7) The correction amount visualization device according to any one of configurations 1 to 6, wherein the correction amount range is at least one. (Configuration 8) The correction amount visualization device according to any one of configurations 1 to 7, wherein the correction amount range is changeable by a user. (Configuration 9) The correction amount visualization device according to any one of configurations 1 to 8, wherein the display form is changeable by a user. (Configuration 10) The correction amount visualization device according to any one of configurations 1 to 9, characterized in that the generation means limits the colors contained in the evaluation image to be displayed in the display form to a predetermined color range. (Configuration 11) The correction amount visualization device described in configuration 10, wherein the generation means displays, in the warning image, colors contained in the evaluation image that are not included in the color range as colors corrected by applying the correction parameters. (Configuration 12) The correction amount visualization device according to configuration 10, wherein the generation means displays, in the warning image, any color contained in the evaluation image that is not included in the color range in that color. (Configuration 13) The correction amount visualization device according to any one of configurations 1 to 12, wherein the color range is changeable by a user. (Configuration 14) A correction amount visualization device as described in any one of configurations 1 to 13, characterized in that when the generation means does not generate the warning image, it generates as the output image an image after the evaluation image has been corrected by applying the correction parameters, or the evaluation image. (Configuration 15) The correction amount visualization device described in any one of claims 1 to 14, characterized in that the generation means, among the colors contained in the evaluation image, displays the colors in the warning image in the display form by distinguishing between colors that are within the dynamic range of the colors contained in the target color information of the target imaging device and colors that are outside the dynamic range. (Configuration 16) The correction amount visualization device according to configuration 15, wherein the generating means superimposes a frame indicating the dynamic range on the output image. (Configuration 17) The correction amount visualization device according to any one of configurations 1 to 16, wherein the correction parameters are a correction lookup table. (Method 1) A method for controlling a correction amount visualization device that visualizes a correction amount of a color corrected by applying a correction parameter, comprising the steps of: the correction parameters are calculated based on reference color information and target color information obtained by a reference imaging device and a target imaging device photographing the same color chart, thereby making it possible to correct colors that are not included in the color chart; an input step of inputting an evaluation image; generating, as an output image, a warning image showing, among colors included in the evaluation image, colors whose correction amount when corrected by applying the correction parameter falls within a predetermined correction amount range or colors whose correction amount does not fall within the predetermined correction amount range in a display form corresponding to the correction amount range; and an output step of outputting the output image. (Program 1) A program for causing a computer to execute each means of the correction amount visualization device according to any one of configurations 1 to 17. [Explanation of symbols]

[0090] 101a Reference camera (reference imaging device) 101b Target camera (target imaging device) 103 Correction amount visualization device (correction amount visualization device) 104 Color Chart 710 Warning image generating unit (input means) (generating means) (output means)

Claims

1. A correction amount visualization device that visualizes a correction amount of a color corrected by applying a correction parameter, comprising: the correction parameters are calculated based on reference color information and target color information obtained by a reference imaging device and a target imaging device photographing the same color chart, thereby making it possible to correct colors that are not included in the color chart; an input means for inputting an evaluation image; a generating means for generating, as an output image, a warning image which indicates, among colors included in the evaluation image, colors whose correction amount when corrected by applying the correction parameter falls within a predetermined correction amount range or does not fall within the predetermined correction amount range in a display form corresponding to the correction amount range; and an output unit that outputs the output image.

2. The correction amount visualization device according to claim 1, characterized in that the generation means displays, among the colors contained in the evaluation image, colors whose correction amount when corrected by applying the correction parameter is not included in the correction amount range in the warning image as the color after correction by applying the correction parameter.

3. The correction amount visualization device according to claim 1, characterized in that the generation means displays, in the warning image, a color among the colors contained in the evaluation image, whose correction amount when corrected by applying the correction parameter is not included in the correction amount range.

4. 2. The correction amount visualization device according to claim 1, wherein an image input from outside or an image satisfying an evaluation image condition is input to the input means as the evaluation image.

5. 5. The correction amount visualization device according to claim 4, wherein the evaluation image condition is one of a same hue value, a same lightness value, and a same saturation value.

6. 5. The correction amount visualization device according to claim 4, wherein the evaluation image conditions are changeable by a user.

7. 2. The correction amount visualization device according to claim 1, wherein the correction amount range is at least one.

8. 2. The correction amount visualization device according to claim 1, wherein the correction amount range is changeable by a user.

9. 2. The correction amount visualization device according to claim 1, wherein the display form is changeable by a user.

10. 2. The correction amount visualization device according to claim 1, wherein the generating means limits colors to be displayed in the display form, among colors included in the evaluation image, to a predetermined color range.

11. The correction amount visualization device according to claim 10, characterized in that the generation means displays, in the warning image, colors contained in the evaluation image that are not included in the color range as colors corrected by applying the correction parameters.

12. 11. The correction amount visualization device according to claim 10, wherein the generating means displays, in the warning image, a color that is not included in the color range among colors included in the evaluation image, in that color.

13. 11. The correction amount visualization device according to claim 10, wherein the color range is changeable by a user.

14. The correction amount visualization device according to claim 1, characterized in that, when the generation means does not generate the warning image, it generates as the output image an image obtained by correcting the evaluation image by applying the correction parameters, or the evaluation image.

15. 2. The correction amount visualization device according to claim 1, wherein the generation means distinguishes between colors that are within a dynamic range of colors included in the target color information of the target imaging device and colors that are outside the dynamic range, among the colors included in the evaluation image, and displays the colors in the display form in the warning image.

16. 16. The correction amount visualization device according to claim 15, wherein the generating means superimposes a frame indicating the dynamic range on the output image.

17. 2. The apparatus for visualizing a correction amount according to claim 1, wherein the correction parameters are a correction lookup table.

18. A method for controlling a correction amount visualization device that visualizes a correction amount of a color corrected by applying a correction parameter, comprising the steps of: the correction parameters are calculated based on reference color information and target color information obtained by a reference imaging device and a target imaging device photographing the same color chart, thereby making it possible to correct colors that are not included in the color chart; an input step of inputting an evaluation image; generating, as an output image, a warning image showing, among colors included in the evaluation image, colors whose correction amount when corrected by applying the correction parameter falls within a predetermined correction amount range or colors whose correction amount does not fall within the predetermined correction amount range in a display form corresponding to the correction amount range; and an output step of outputting the output image.

19. A program for causing a computer to execute each of the means of the correction amount visualization device according to claim 1.

Citation Information

Patent Citations

  • Image conversion device, method for controlling image conversion device, program, and storage medium

    JP2021144295A