Controller, control method, and program

Abstract

To provide a controller, a control method, and a program that can apply correction data with a color and brightness according to an application destination.SOLUTION: A controller comprises a generation unit that generates first correction data for color and brightness adjustment on the basis of a picked-up image of a color chart picked up by a reference imaging apparatus to be a reference of color and brightness adjustment and a target imaging apparatus to be a target of color and brightness adjustment, and can apply the correction data to an application destination device. The controller comprises: a setting unit for setting the application destination device; acquisition means that acquires second correction data to be composed with the first correction data; a composition unit that generates third correction data obtained by composing the first correction data and the second correction data with each other; and an application unit that applies the first correction data or the third correction data according to the set application destination device.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a control device, a control method, and a program for appropriately applying correction data used for color and brightness correction to an apparatus. [Background technology]

[0002] In video production, multiple imaging devices are typically used for imaging. Even when capturing the same subject, the resulting captured images have different color and brightness due to differences in the model numbers of the imaging devices used. Therefore, correction data for adjusting color and brightness is generated based on the color chart images captured by each imaging device and applied to the target imaging device to be corrected. However, in outdoor shooting, even if color and brightness are adjusted in advance, color and brightness may shift due to weather changes and other factors. In such cases, for example, the color chart is re-imaged using a "reference imaging device" that serves as the basis for color and brightness adjustment, and a "target imaging device" to which the correction data has been applied. Then, correction data is re-generated based on the captured image. Furthermore, the re-generated correction data is combined with the original correction data already applied to the target imaging device to obtain new correction data, which is then applied to the target imaging device to adjust color and brightness.

[0003] On the other hand, in recent years, display devices have been proposed that can apply correction data to input images from multiple imaging devices and display the images, and there are an increasing number of cases in which correction data is applied to devices other than imaging devices to adjust color and brightness.Patent Document 1 discloses a technology in which, when applying correction data to received one-segment images, correction data is generated from image data, and if existing correction data exists, the two are combined to apply the new correction data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-290609 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with conventional technology, problems could arise when applying new correction data obtained by combining the applied correction data with regenerated correction data to a display device that inputs an image captured by an imaging device to which correction data has already been applied. That is, there was a risk that the effects of the applied correction data would overlap, resulting in mismatched color and brightness. For this reason, users had to manually switch whether or not to combine correction data each time, depending on the application destination of the correction data. However, there was a problem in that human error, such as forgetting to switch correction data or applying correction data to the wrong destination, could result in the generation and application of incorrect correction data, resulting in mismatched color and brightness.

[0006] An object of the present invention is to provide a control device, a control method, and a program that can apply color and brightness correction data according to the application destination. [Means for solving the problem]

[0007] In order to achieve the above object, one aspect of the present invention is a control device that includes a generation means for generating first correction data for color and brightness adjustment based on an image of a color chart captured by a reference imaging device that serves as a reference for color and brightness adjustment and a target imaging device that is the target of color and brightness adjustment, and that can apply the correction data to a destination device, the control device including: a setting means for setting the destination device; an acquisition means for acquiring second correction data to be combined with the first correction data; a combination means for generating third correction data by combining the first correction data and the second correction data; and an application means for applying the first correction data or the third correction data depending on the destination device set by the setting means. [Effects of the Invention]

[0008] According to the present invention, it is possible to obtain an effect that color and brightness correction data can be applied according to the application destination. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating a system configuration. [Figure 2] 10 is a flowchart showing a correction data generation and application process according to the first embodiment. [Figure 3] FIG. 1 is an explanatory diagram of a color chart. [Figure 4] FIG. 1 is an explanatory diagram of a 3D-LUT. [Figure 5] 10 is a display example of a UI for setting a destination device. [Figure 6] FIG. 10 is an explanatory diagram of correction data to be synthesized. [Figure 7] 10 is a flowchart showing a correction data generation and application process according to the second embodiment. [Figure 8] This is an example of a composite selection UI display. [Figure 9] 10 is a display example of a synthetic data setting UI. [Figure 10] 10 is a display example of an application selection UI. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments. First, a first embodiment of the present invention will be described. Furthermore, in the following embodiments, all correction data for adjusting color and brightness will be described as a 3-LUT (lookup table), but the correction data is not limited to this.

[0011] First Embodiment (Figure 1: System configuration diagram) First, a first embodiment of the present invention will be described. Fig. 1 is a configuration diagram of a system according to an embodiment of the present invention. As shown in Fig. 1, the system according to the first embodiment includes a reference imaging device 10, a target imaging device 20, a display device 30, and a control device 40.

[0012] (Reference imaging device 10: Target imaging device 20) The reference imaging device 10 is an imaging device that serves as a reference for color and brightness adjustment, and outputs captured images (still images and moving images) to the control device 40. The reference imaging device 10 also outputs captured images to the display device 30 via a cable (not shown). The target imaging device 20 is an imaging device that is the target for color and brightness adjustment, and outputs captured images (still images and moving images) to the control device 40. The target imaging device 20 also outputs captured images to the display device 30 via a cable (not shown). The target imaging device 20 can apply correction data for matching color and brightness with the reference imaging device 10, and correction data for converting captured images to conform to a desired video standard and desired atmosphere. Hereinafter, correction data for converting the color and brightness of an input captured image will be referred to as "correction data."

[0013] (Display device 30) The display device 30 displays the captured images received from the reference imaging device 10 and the target imaging device 20 via cables (not shown). The display device 30 is also capable of applying correction data. Here, the correction data applied is data for correcting the color and brightness of the captured images of the target imaging device 20 received via cables (not shown). The display device 30 also displays the captured images after the correction data has been applied.

[0014] (Control device 40) The control device 40 has a control unit 41, a communication unit 42, a memory 43, a display unit 44, an operation unit 45, a generation unit 46, a synthesis unit 47, and an application destination determination unit 48, and these components are connected by a control bus 49 so that required information can be transmitted and received between them. The control device 40 generates, synthesizes, applies, etc. correction data. Note that "synthesis" is one form of generation, which will be described later with reference to FIG. 6.

[0015] (Control unit 41: Communication unit 42: Memory 43) The control unit 41 includes a microcomputer and executes a program stored in the memory 43 to control the overall operation of the control device 40. The CPU, which serves as a processor constituting the microcomputer, executes the program to realize various functions (processing) in this embodiment. The communication unit 42 includes an interface compatible with wired communication such as LAN, USB, HDMI (registered trademark), and SDI, and an interface compatible with wireless communication such as Bluetooth (registered trademark) and Wi-Fi (registered trademark), and can receive data from outside the control device 40. The memory 43 stores captured images received by the communication unit 42, programs executed by the control unit 41, and the like, and is also used as a buffer when various processes are executed. The memory 43 also stores correction data generated and synthesized by the generation unit 46 and synthesis unit 47, respectively, and display information displayed on the display unit 44 by the control unit 41, and the like. The memory 43 can be realized by a volatile memory such as RAM, a non-volatile memory such as ROM, flash memory, or HDD (hard disk drive), and the like.

[0016] (Display section 44: Operation section 45) The display unit 44 displays, for example, a list of devices to which correction data is to be applied among devices connected to the control device 40, and information (hereinafter referred to as "setting information") related to various controls of the control device 40. The operation unit 45 is an input device that allows the user to provide required information such as designation of a device to which correction data is to be applied to the control unit 41, and is realized by, for example, a mouse, a keyboard, etc.

[0017] (Generation unit 46: Synthesis unit 47: Application destination determination unit 48) The generation unit 46 generates correction data (hereinafter referred to as "first correction data") based on captured images (hereinafter referred to as "images for generation") of a color chart for adjusting color and brightness captured by the reference imaging device 10 and the target imaging device 20, which are stored in the memory 43. The synthesis unit 47 performs a process of determining whether or not to synthesize correction data depending on the application destination device, and synthesizes the correction data. The synthesis (generation) of correction data will be described later. The application destination determination unit 48 determines the application destination device of the correction data depending on a setting operation by the user. Specifically, the generation unit 46 generates screen information for displaying on the display unit 44 a user interface (hereinafter referred to as "application destination setting UI") for allowing the user to set the application destination device of the correction data, and outputs the screen information to the display unit 44.

[0018] 1, the destination devices are the target imaging device 20 and the display device 30, but the number and type of destination devices are not limited to these. Alternatively, the reference imaging device 10 and the target imaging device 20 may not be connected to the control device 40, and a recording medium on which images captured by the reference imaging device 10 and the target imaging device 20 are recorded may be attached to the control device 40 to generate the first correction data. Furthermore, it is not necessary for multiple destination devices to be connected at the same time, and only one destination device may be used, which may be an imaging device, a display device, or another device.

[0019] (FIG. 2: Flowchart showing correction data generation and application processing of the first embodiment) Next, a process for generating, synthesizing, and applying correction data according to a target device, which is a characteristic process of the first embodiment, will be described. FIG. 2 is a flowchart showing the process for generating and applying correction data according to the first embodiment. The process shown in FIG. 2 is started in response to the control unit 41 receiving a process start instruction given by the user through operation of the operation unit 45. It is assumed that the user has set which of the imaging devices connected to the control device 40 will be used as the "reference for color and brightness adjustment" and which imaging device will be used as the "target for color and brightness adjustment" before the process shown in FIG. 2 is started. In addition, as shown in FIG. 1, in this embodiment, a case will be described in which the reference imaging device 10, target imaging device 20, and display device 30 can be the target device.

[0020] It is also assumed that the user has previously stored the captured images (hereinafter referred to as "images for generation") of the reference imaging device 10 and the target imaging device 20 used to generate the first correction data in the memory 43. In the following description, it is also assumed that the operation and processing of each unit in the control device 40 are performed under the control of the control unit 41.

[0021] (Step S21: Generation of first correction data: FIG. 3: Explanation of color chart) First, in step S21, the generation unit 46 refers to an image for generation stored in the memory 43. Here, the "image for generation" is, for example, an image of a color chart captured by each of the reference imaging device 10 and the target imaging device 20. FIG. 3 is a diagram showing an example of a color chart 500. On the color chart 500, square patches 501 to 512, which are multiple measurement images of different colors, are arranged in a matrix. The differences in the pattern of the patches 501 to 512 shown in FIG. 3 represent the differences in color.

[0022] (Fig. 4: 3D-LUT diagram) Next, the generation unit 46 generates "first correction data" based on the referenced image for generation. Here, the first correction data is described in, for example, a 3D-LUT (Look Up Table). FIG. 4 is an explanatory diagram of an example of a 3D-LUT. Here, for example, the captured image before color and brightness correction has "8-bit" gradation for each of RGB. The 3D-LUT is a table that links RGB input values ​​before color and brightness correction with RGB output values ​​after color and brightness correction on a one-to-one basis.

[0023] In Figure 4, "Rin, Gin, Bin" respectively represent the R, G, and B gradation values ​​before color and brightness correction, and "Rout, Gout, Bout" respectively represent the R, G, and B gradation values ​​after color and brightness correction. This 3D-LUT has 256 gradations (0 to 255) for each RGB, and the input gradation changes in one-step increments, resulting in a table consisting of approximately 16.77 million combinations of "R256 x G256 x B256." For example, if the RGB values ​​of a pixel in a captured image before color and brightness correction are (Rin, Gin, Bin) = (0, 255, 255), then the 3D-LUT in Figure 4 becomes (Rout, Gout, Bout) = (13, 245, 252).

[0024] The generation unit 46 generates "first correction data," for example, as described below. That is, the "first correction data" is generated so that the color and brightness of the patches 501 to 512 in the color chart captured image captured by the target imaging device 20 become closer to the color and brightness of the patches 501 to 512 in the color chart captured image captured by the reference imaging device 10. The generated first correction data is stored in the memory 43. Here, a 3D-LUT has been described as an example of the first correction data, but the first correction data is not limited to this, and for example, a 1D-LUT, a color matrix, or the like, which are known in the art, or a combination of multiple types of methods, may be used.

[0025] (Step S22: Display application destination setting UI) Next, in step S22, the application destination determination unit 48 generates an application destination setting UI for allowing the user to select an application destination device based on the detection result of the devices connected to the control device 40, and outputs the UI to the display unit 44.

[0026] (Figure 5: Example of the UI for setting the target device) FIG. 5 is an explanatory diagram showing an example of the display of the application destination setting UI. A character string prompting the user to select an application destination device is displayed at the top of the display screen of the application destination setting UI shown in FIG. 5. Specifically, the message "Please select one of the application destination candidates below to which the correction data will be applied." is displayed. Below this character string, a table consisting of "Select" and "Application Destination Candidate" is displayed, and the "Select" column displays check boxes for the user to select an application destination device. Furthermore, the "Application Destination Candidate" column displays information about devices connected to the control device 40, detected by the application destination determination unit 48 (hereinafter referred to as "device information"). Here, in FIG. 5, as a result of the application destination determination unit 48 detecting devices connected to the control device 40, three types of devices, "reference imaging device 10, target imaging device 20, and display device 30," connected to the control device 40 are displayed, as shown in FIG. 1.

[0027] 5 shows the result of the user selecting "target imaging device 20" as the target device, i.e., the state in which the checkbox for "target imaging device" is checked. Here, the above-mentioned "device information" refers to a character string that can identify each device connected to the control device 40. For example, like "display device" displayed in the bottom row of the table in FIG. 5, it refers to a character string that indicates the category of the device, or a character string such as "reference imaging device" or "target imaging device" with the character strings "reference" and "target" added to the beginning to indicate differences within the same device category.

[0028] Alternatively, the device information may be a character string formed by concatenating the model number, serial number, etc. of the device. In FIG. 5, all devices connected to the control device 40 are displayed as "candidates for application," but it is also possible to display only devices in a specific category (in this case, devices related to display), such as display devices, or only devices with a specific model number. Also, it is possible to display only devices equipped with communication means capable of communicating correction data with the control device 40. Furthermore, it is also possible to allow the user to set, change, and select the device conditions displayed as "candidates for application" in the application device setting UI.

[0029] After the application destination determination unit 48 outputs the application destination setting UI to the display unit 44, the display unit 44 displays the received application destination setting UI on the screen. Then, the user operates the operation unit 45 while checking the application destination setting UI shown in FIG. 5 displayed on the display unit 44, to check a checkbox to select an "application destination device." Upon receiving the user's selection result of an "application destination candidate," the application destination determination unit 48 stores the user's selection result in the memory 43 (hereinafter referred to as "selection result"). Here, the "selection result" refers to device information of the "application destination device."

[0030] (Step S23) Next, in step S23, the application destination determination unit 48 refers to the selection result stored in the memory 43 and identifies the application destination device. If the application destination determination unit 48 determines that the identified application destination device is an imaging device (Y), it transmits a corresponding signal indicating "correspondence" to the control unit 41. On the other hand, if it determines that the device is other than this (N), the application destination determination unit 48 transmits a non-correspondence signal indicating "non-correspondence" to the control unit 41. If the control unit 41 receives a corresponding signal (Y), it controls the synthesis unit 47 to proceed to step S24. On the other hand, if it receives a non-correspondence signal (N), the control unit 41 proceeds to step S28.

[0031] (Device Category) Here, the application destination determination unit 48 may determine whether the application destination device is an "imaging device" in the following manner, for example. If the control device 40 is equipped with an OS (Operating System), one method is to use the API (Application Programming Interface) of the OS. Specifically, the application destination determination unit 48 acquires the "device category" of the application destination device using the API of the OS. Here, the "device category" is information indicating the type of device, such as a camera or a display. Also, information specifying which "device category" corresponds to an imaging device (hereinafter referred to as "specifying information") is assumed to be stored in advance in the memory 43. In this way, the application destination determination unit 48 refers to the "specifying information" stored in the memory 43 and determines whether the acquired device category corresponds to an imaging device.

[0032] Alternatively, the "device category" information may be obtained directly from the destination device using a communication means (hereinafter referred to as "transmission / reception means") capable of transmitting and receiving various information to and from the destination device. For example, the destination determination unit 48 may obtain information regarding the "device category" from the destination device using the transmission / reception means, and determine whether the destination device is an imaging device based on the obtained information. Here, the "transmission / reception means" is a means for communicating information using, for example, an IP protocol or the like.

[0033] (Step S24: Application information) Next, in step S24, the synthesis unit 47 refers to the selection result stored in the memory 43 to identify the destination device, and obtains, using the transmitting / receiving means, information (hereinafter referred to as "application information") from the destination device that can determine whether the correction data has been applied to the destination device. Here, the "application information" is information that indicates the application status of the correction data in the destination device, and is, for example, information that is a character string such as "applied" if the correction data has been applied, or "not applied" if the correction data has not been applied.

[0034] (Determine whether or not "second correction data" exists in the target device) If the combining unit 47 determines based on the "application information" that the correction data has already been applied to the destination device, it transmits an "application signal" indicating application to the control unit 41, whereas if the correction data has not been applied, it transmits an "unapplication signal" indicating unapplication to the control unit 41. If the control unit 41 receives an "application signal" (Y), it controls the combining unit 47 to proceed to step S25. On the other hand, if the control unit 41 receives an "unapplication signal" (N), the control unit 41 proceeds to step S28. Specifically, the combining unit 47 determines whether or not "second correction data" exists in the destination device, and if "second correction data" does not exist in the destination device (N), it proceeds to step S28. On the other hand, if the combining unit 47 determines that "second correction data" exists in the destination device (Y), it proceeds to step S25.

[0035] (First notification selection UI: Applied button: Not applied button) Here, a case will be described in which the combining unit 47 is unable to acquire application information from the application destination device using the transmission / reception means. For example, the combining unit 47 generates a "notification character string" notifying that the "application information" could not be acquired and a UI showing a button that allows the user to select whether or not the correction data has been applied to the application destination device (hereinafter referred to as the "first notification selection UI"), and outputs these to the display unit 44. The user can directly check whether or not the correction data has been applied to the application destination device by looking at the "notification character string" displayed on the display unit 44. If the user determines that the correction data has been applied to the application destination device as a result of the check, the user operates the operation unit 45 to press the "applied button" in the "first notification selection UI" indicating that the correction data has been applied. On the other hand, if the user determines that the correction data has not been applied, the user presses the "not applied button" indicating that the correction data has not been applied.

[0036] When the "applied button" indicating that the first notification selection UI has been applied is pressed, the synthesis unit 47 transmits an "application signal" indicating that the notification has been applied to the control unit 41. On the other hand, when the "not applied button" indicating that the notification has not been applied is pressed, the synthesis unit 47 transmits an "not applied signal" indicating that the notification has not been applied to the control unit 41. When the control unit 41 receives the "application signal" (Y), the synthesis unit 47 controls the synthesis unit 47 to proceed to step S25. On the other hand, when the control unit 41 receives the "not applied signal" (N), the control unit 41 proceeds to step S28.

[0037] (Step S25) Next, in step S25, the synthesis unit 47 acquires the correction data that has been applied to the destination device (hereinafter referred to as "second correction data") from the destination device using the transmitting / receiving means, and stores it in the memory 43. The second correction data is, for example, a 3D-LUT similar to the first correction data.

[0038] (Selection Start Button: Second Notification Selection UI) Here, a case will be described in which the combining unit 47 is unable to acquire the "second correction data" from the destination device using the transmission / reception means. The combining unit 47 generates a UI (hereinafter "second notification selection UI") that displays a character string notifying that the second correction data could not be acquired and a button (hereinafter "selection start button") for starting a process for the user to select the second correction data, and outputs the UI to the display unit 44. As a result, the display unit 44 displays the character string and the second notification selection UI described above.

[0039] (Search for second correction data: Pass) After checking the second notification selection UI displayed on the display unit 44, the user presses the selection start button of the second notification selection UI. Next, the user operates the operation unit 45 while looking at the display unit 44 to search for and select "second correction data" from the memory 43 or a storage area other than the memory 43 that is accessible to the control device 40. The synthesis unit 47 stores the path of the second correction data selected by the user in the memory 43. Here, the "path" is a character string indicating the location of the data within the control device 40 or a storage area other than the memory 43 that is accessible to the control device 40, and is information used by the synthesis unit 47 to acquire the second correction data.

[0040] (Step S26: Synthesis of third correction data) Next, in step S26, the combining unit 47 stores correction data (hereinafter referred to as "third correction data") obtained by generating (combining) the "first correction data" generated in step S21 and the "second correction data" acquired in S25 in the memory 43. Here, the "third correction data" is, for example, a 3D-LUT similar to the "first correction data." Next, the combining of the "third correction data" will be described using an example in which the first, second, and third correction data are 3D-LUTs.

[0041] (Figure 6: First correction data and second correction data: synthesized (generated) third correction data) Fig. 6 shows the 3D-LUT of the first correction data and the second correction data. Here, the third correction data is a table created by linking "Rin, Gin, Bin" of the second correction data shown in Fig. 6 with "Rout, Gout, Bout" of the first correction data.

[0042] As an example, we will explain how to find (Rout, Gout, Bout) associated with (Rin, Gin, Bin) = (1, 0, 254) of the third correction data. First, referring to the second correction data, (Rout, Gout, Bout) = (2, 2, 250) is associated with (Rin, Gin, Bin) = (1, 0, 254).

[0043] Next, "Rout, Gout, Bout" of the second correction data are set to "Rin, Gin, Bin" of the first correction data. Then, (Rout, Gout, Bout) = (10, 5, 240) is linked to (Rin, Gin, Bin) = (2, 2, 250) from the first correction data. As a result, (Rout, Gout, Bout) = (10, 5, 240) is linked to (Rin, Gin, Bin) = (1, 0, 254) from the third correction data. Similarly, by finding (Rout, Gout, Bout) linked to all (Rin, Gin, Bin), the third correction data is obtained. In other words, the third correction data is generated (synthesized) using "Rin, Gin, Bin" in the second correction data as input and "Rout, Gout, Bout" of the first correction data as output. This process is called "compositing."

[0044] In the above explanation, the second correction data is an 8-bit gradation 3D-LUT, but there are cases where the steps of the table are thinned out to reduce the size of the LUT, etc. In such cases, the thinned out steps can be complemented using an algorithm such as triangular pyramid interpolation, which is a well-known technique, to return the data to 8-bit gradation, and then the data can be combined with the first correction data.

[0045] (Step S27: Application of third correction data) Next, in step S27, the control unit 41 acquires the third correction data stored in the memory 43 and applies the "third correction data" to the destination device using the transmitting / receiving means. Here, when applying the "third correction data" to the destination device using the transmitting / receiving means, first, the correction data that has already been applied to the destination device is deleted to bring the destination device into a state where no correction data has been applied, and then the "third correction data" is applied.

[0046] Here, if the control unit 41 cannot apply the "third correction data" to the application destination device using the transmission / reception means, the control unit 41 generates a UI showing a character string notifying the user that the data cannot be applied, and outputs the UI to the display unit 44. After viewing the UI displayed on the display unit 44, the user manually applies the "third correction data" to the application destination device. Here, the manual application method may be, for example, a method in which the "third correction data" stored in the memory 43 is input to the application destination device using a portable recording medium or wired or wireless communication means, and the application destination device is then directly operated to apply the data.

[0047] (Step S28) Then, in step S28, the control unit 41 applies the first correction data to the destination device, as in S27. If the destination device is not an imaging device in step S23 (N), in this embodiment the first correction table is applied to the display device 30. After the control unit 41 applies the correction data to the destination device in step S27 or step S28, the control unit 41 ends the processing shown in Fig. 2. In the example shown in Fig. 1, there are cases where the first correction data is applied to the display device 30 and cases where the destination device is an imaging device but the first correction data does not exist for the imaging device.

[0048] Also, although different from FIG. 1, when there is only one target device and no correction data has been applied to that device, the first correction data generated by the generation unit 46 is applied to that device. On the other hand, when there is only one target device and second correction data different from the first correction data has been applied, third correction data obtained by combining the second correction data acquired from that device and the first correction data generated by the generation unit 46 is applied. Furthermore, the control unit 41 acquires second correction data from "a device to which the second correction data has been applied, regardless of whether it has been set as a target device at that time."

[0049] By performing the above-described processing, correction data is generated that can be applied by switching whether or not to synthesize the correction data depending on the device to which it is to be applied, making it possible to generate and apply color and brightness correction data appropriate for the device to which it is to be applied while minimizing human error.

[0050] Second Embodiment Next, a second embodiment of the present invention will be described. In the first embodiment, an example was shown in which, when the destination device is other than an imaging device, first correction data is applied to the destination device. In the second embodiment, an example will be described in which, when the destination device is other than an imaging device, processing is added to determine whether or not to combine correction data and processing that allows the user to select the correction data to be combined. Here, the configuration of the control device 40 and system in the second embodiment is the same as in the first embodiment, so repeated explanations will be omitted.

[0051] <Basic operation> (FIG. 7: Flowchart showing correction data generation and application processing of the second embodiment) An example will be described below in which, as a feature of the second embodiment, when the application destination device of the first embodiment is other than an imaging device, a process of whether or not to synthesize correction data and a process of allowing the user to select the correction data to be synthesized are added. FIG. 7 is a flowchart showing the correction data generation and application process of the second embodiment. The process shown in FIG. 7 is started by the control unit 41 in response to a start operation by the user on the operation unit 45. It is assumed that the user has specified which of the imaging devices connected to the control device 40 will be used as the "reference" or "target" for color and brightness adjustment before the start of the process shown in FIG. It is also assumed that the user has previously stored in the memory 43 the image for generation used to generate the first correction data. In the following description, it is assumed that the processing of each unit of the control device 40 is performed under the control of the control unit 41.

[0052] (Step S701: Step S702: Step S703) The processing of steps S01 and S702 in Fig. 7 is similar to the processing of steps S21 and S22 in Fig. 2, and therefore redundant explanations will be omitted. In step S703, the same processing as step S23 in Fig. 2 is performed, but in particular, if the application destination device is other than an imaging device and the control unit 41 receives a "non-applicable signal" indicating non-application from the application destination determination unit 48 (N), the control unit 41 proceeds to the processing of step S708. In step S703, the processing of steps S704 to S707, which are executed when the application destination device is an imaging device (Y), is similar to the processing of steps S24 to S27 in Fig. 2, and therefore redundant explanations will be omitted.

[0053] (Step S708: FIG. 8: Example of UI display for selecting whether to combine) In S708, the combining unit 47 generates a UI (hereinafter referred to as "combining selection UI") for allowing the user to select whether or not to combine the first correction data with other correction data, and outputs the UI to the display unit 44. FIG. 8 is a display example of the combining selection UI. A character string is displayed at the top of the display screen of the combining selection UI shown in FIG. 8, prompting the user to select whether or not to combine the first correction data with other correction data. Specifically, the character string "Do you want to combine the first correction data with other correction data?" is displayed. In addition, first and second buttons are displayed below the character string to allow the user to select whether or not to combine. Of the two types of buttons shown in FIG. 8, the first button marked "Yes" is a "button indicating consent to combining," and the second button marked "No" is a "button indicating consent not to combining."

[0054] After the synthesis unit 47 outputs the synthesis selection UI to the display unit 44, the display unit 44 displays the received synthesis selection UI on the screen. While looking at the display unit 44, the user operates the operation unit 45 to press the first button "Yes" in FIG. 8 if synthesis is to be performed, or the second button "No" if synthesis is not to be performed. The synthesis unit 47 receives input from the user and stores the selection result regarding synthesis made by the user (hereinafter referred to as "synthesis selection result") in the memory 43. The "synthesis selection result" is information that can determine whether synthesis is to be performed, and is, for example, a character string such as "synthesize" or "do not synthesize."

[0055] (Step S709: Determine whether to combine) Next, in step S709, the synthesis unit 47 refers to the synthesis selection result stored in the memory 43 and determines whether or not to perform synthesis. If the synthesis unit 47 determines to perform synthesis (Y), it transmits a "correspondence signal" indicating a correspondence to the control unit 41, whereas if it determines not to perform synthesis (N), it transmits a "non-correspondence signal" indicating a non-correspondence to the control unit 41. If the control unit 41 receives a correspondence signal (Y), it controls the synthesis unit 47 to proceed to S710. On the other hand, if the control unit 41 receives a non-correspondence signal (N), it proceeds to the process of S713.

[0056] (Step S710: FIG. 9: Composite Data Setting UI: Fourth Correction Data) Next, in step S710, the combining unit 47 generates a UI (hereinafter, "combined data setting UI") for allowing the user to select fourth correction data and outputs it to the display unit 44. FIG. 9 is a display example of the combined data setting UI. A character string urging the user to select "fourth correction data" is displayed at the top of the display screen of the combined data setting UI shown in FIG. 9. Specifically, the character string "Please select the correction data to be combined with the first correction data" is displayed. Below this character string, a table consisting of "Select" and "Correction Data Name" is displayed. The "Select" column displays a check box for the user to select "fourth correction data." Furthermore, the "Correction Data Name" column displays the names of candidate data for the "fourth correction data" extracted by the combining unit 47 by referring to the contents stored in the memory 43. Here, the fourth correction data can be extracted, for example, by extracting data having the same file format as the first correction data.

[0057] The table in FIG. 9 illustrates a case in which the combining unit 47 extracts candidate data for the fourth correction data by referencing the contents of memory 43, resulting in the extraction of data named "Data 1, Data 2, and Data 3." Furthermore, the table in FIG. 9 illustrates a case in which the user selects "Data 2" as the fourth correction data, resulting in the checkbox corresponding to Data 2 being checked. Here, the extraction method for the fourth correction data targets data stored in memory 43. However, for example, data stored in a storage area external to the control device 40 and accessible by the control device 40 may also be used as the extraction target. Alternatively, instead of having the combining unit 47 extract and display candidate fourth correction data as shown in FIG. 9 and having the user select from the list, the user may directly search for and specify the fourth correction data. In this case, for example, processing similar to step S25 in FIG. 2 may be performed.

[0058] After the combining unit 47 outputs the combining data setting UI to the display unit 44, the display unit 44 displays the received combining selection UI on the screen. The user checks the combining data setting UI of FIG. 9 displayed on the display unit 44 and operates the operation unit 45 to check the checkbox of the correction data to be set as the fourth correction data. Upon receiving the user's input, the combining unit 47 stores the user's setting result in the memory 43. Here, the user's setting result is the path of the fourth correction data set by the user, etc.

[0059] Furthermore, as shown in FIG. 9, instead of the synthesis unit 47 extracting and displaying candidates for the fourth correction data and allowing the user to select from them, the synthesis unit 47 may also store the path in the memory 43 even when the user directly searches for and specifies the fourth correction data.

[0060] (Step S711: Fifth correction data (combination of first correction data and fourth correction data) Next, in step S711, the combining unit 47 combines the "first correction data" generated in S701 with the "fourth correction data" whose path was stored in the memory 43 in S710. The correction data obtained by combining the data (hereinafter referred to as "fifth correction data") is stored in the memory 43. The fifth correction data is, for example, a 3D-LUT similar to the first correction data. Also, for example, if the first correction data, fourth correction data, and fifth correction data are all 3D-LUTs, the fifth correction data will be as follows. That is, the fifth correction data is a table linking "Rin, Gin, Bin" of the first correction data with "Rout, Gout, Bout" of the fourth correction data, as in step S26. That is, the fifth correction data is generated (synthesized) using "Rin, Gin, Bin" of the fourth correction data as input and "Rout, Gout, Bout" of the first correction data as output.

[0061] (Step S712: Step S713) The process in the next step S712 is the same as the process in S707. Moreover, the process in S713 is the same as the process in step S28 in Fig. 2. As described above, in the process in any one of steps S707, S712, and S713, as soon as the control unit 41 applies the correction data to the application destination device, the control unit 41 ends the process in Fig. 7.

[0062] As described above, the second embodiment adds a process to the first embodiment in which the user can select whether or not to synthesize correction data when the destination device is other than an imaging device, and the correction data to be synthesized. Therefore, color and brightness correction data suitable for the destination device can be generated and applied while suppressing human error.

[0063] In the first and second embodiments, two imaging devices and one display device are connected to the control device 40, but three or more imaging devices and two or more display devices may be connected. Furthermore, while the imaging device and the display device are used as examples of devices to which the correction data can be applied, the correction data is not limited to the imaging device and the display device. Any device to which the correction data can be applied may be used, and other types of devices, such as a video switcher, may also be used. While the above description has been given of displaying various captured images on the display device 30 and displaying setting information on the display unit 44, a configuration may be adopted in which the display device 30 also displays setting information and the display unit 44 is not provided.

[0064] In the above-described embodiment, the example has been described in which the user is prompted to make a selection each time a destination device is determined, and the destination device is determined based on the user's selection. However, instead of prompting the user to make a selection each time, the destination device may be determined based on a predetermined condition (hereinafter referred to as the "destination determination condition"). Here, the "destination determination condition" is, for example, a condition in which values ​​indicating the correction accuracy of the correction data of the destination devices are compared, and the device with the highest correction accuracy is designated as the destination device. In this way, the destination determination unit 48 may be configured to automatically set the device with the highest correction accuracy of the applied correction data as the destination device.

[0065] Here, the value indicating the correction accuracy is, for example, the number of grid points when a 3D-LUT is assumed as the correction data. The "number of grid points" is a value indicating the number of steps remaining when table steps are thinned out to reduce the LUT size of the 3D-LUT. Grid points generally used are "17 points, 33 points, 65 points," etc., and the larger the number, the higher the accuracy tends to be, as long as the algorithm for interpolating between grid points is the same. Here, an example has been described in which values ​​indicating the correction accuracy are compared as the "destination determination condition," but other methods, such as determining the application device based on the interpolation algorithm used, may also be used.

[0066] The destination device may also be determined based on a condition that combines a value indicating the correction accuracy and an interpolation algorithm. Alternatively, the destination device may be determined based on information on factors that can be compared more generally between candidate destination devices and that may affect the correction accuracy when the correction data is applied (hereinafter referred to as "destination determination information"). Here, the destination determination information can be obtained, for example, by the "transmission / reception means" described above.

[0067] Alternatively, a list (hereinafter referred to as "destination priority list") specifying the relative priorities when determining an application destination device may be set as the "destination determination condition," and the application destination device may be determined from among the application destination devices connected to the control device 40 based on the list. Alternatively, a destination priority list may be prepared for each combination of application destination devices connected to the control device 40, and the application destination device may be determined by switching the destination priority list to be referenced depending on the combination of application destination devices connected to the control device 40. In other words, the application destination determination unit 48 may be configured to automatically select and set the application destination device according to the device priorities specified in the priority list.

[0068] Furthermore, the information to be included in the destination priority list may be, for example, device information of the destination device and priority information such as a numerical value that can determine the relative priority when determining the destination device. Here, the device information is the same as that in step S22 of Fig. 2. As described above, the destination determination conditions may be set in advance by the control device, its control method, and program according to the present invention, or may be set, changed, or selected by the user.

[0069] In the first and second embodiments, the generated correction data is applied to the application destination device without the user being asked whether to apply the data before the application. However, the user may be allowed to select whether to apply the data. Specifically, for example, the following process can be executed in steps S27 and S28 of FIG. 2 in the first embodiment, and steps S707, S712, and S713 of FIG. 7 in the second embodiment. That is, the control unit 41 generates a UI (hereinafter referred to as an "application selection UI") that allows the user to select whether to apply the data before applying the data to the application destination device, and outputs the UI to the display unit 44.

[0070] (Fig. 10: Apply Selection UI) FIG. 10 is a display example of the application selection UI. A character string is displayed at the top of the display screen of the application selection UI shown in FIG. 10, prompting the user to select whether or not to apply the generated correction data. Specifically, the character string "Do you want to apply the generated correction data to the application destination device?" is displayed. The character string in FIG. 10 may include, for example, the file name of the correction data to be applied. Also, for example, the device information of the application destination device set by the user may be displayed. The device information is the same as that in step S22 in FIG. 2.

[0071] 10, information (hereinafter referred to as "combining information") is displayed in the form of text below the text in FIG. 10, allowing the user to understand the details of the correction data to be applied, such as "whether or not to combine" and "what the combination is." In FIG. 10, the combining information indicates that the correction data to be applied is generated by combining the first correction data and the fourth correction data. Here, the combining information may include, for example, the file names of the correction data to be combined. Furthermore, instead of displaying text, it may also display image data, such as a generating image used to generate the first correction data. Here, the combining information may be any information that can be used as a reference when the user determines whether or not to apply the generated correction data. As described above, the following information is notified to the application destination device before applying the correction data. That is, the control unit 41 may include a notification unit that displays to the user information indicating whether the correction data to be applied was generated by the combining unit 47 and, if generated by the combining unit 47, information indicating the correction data used in the generation process.

[0072] Also, first and second buttons for the user to select whether or not to apply the generated correction data are displayed below the character string indicating the synthesis information in Fig. 10. Pressing the first button marked "Yes" indicates that the data should be applied, and pressing the second button marked "No" indicates that the data should not be applied.

[0073] After the control unit 41 outputs the application selection UI to the display unit 44, the display unit 44 displays the received application selection UI on the screen. The user operates the operation unit 45 while looking at the display unit 44, and presses the first button "Yes" if the generated correction data is to be applied. On the other hand, the user presses the second button displayed as "No" if the generated correction data is not to be applied. When the first button "Yes" is pressed, the control unit 41 applies the generated correction data to the application destination device, but when the second button "No" is pressed, the correction data is not applied.

[0074] Here, when the user presses the second button "No," the control unit 41 may return to a specific processing step in Fig. 2 or Fig. 7 and redo the series of processes. Redoing the processes may include, for example, returning to step S22 in Fig. 2 or step S702 in Fig. 7 and redoing the process from the selection of the application destination device, or returning to S710 in Fig. 7 and redoing the process from the selection of the correction data to be combined with the first correction data. Furthermore, when redoing the processes, the user may be allowed to select which process in Fig. 7 to redo.

[0075] (others) Although the embodiments of the present invention have been described above, the scope of application of the present invention is not limited to these specific embodiments, and various modifications and alterations can be made without departing from the spirit of the present invention, and these are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate. Furthermore, the present invention also includes a case where a software program that realizes the functions of the above-described embodiments is supplied to a system or device having a computer capable of executing the program directly from a recording medium or via wired or wireless communication, and the program is executed.

[0076] Therefore, the program code itself that is supplied to and installed on a computer to realize the functions (processing) of the present invention also realizes the present invention. In other words, the computer program itself for realizing the functions (processing) of the present invention is also included in the present invention. As long as the program functions are maintained, the form of the program is not important, such as object code, a program executed by an interpreter, middleware, script data supplied to an OS, etc.

[0077] Furthermore, examples of recording media for supplying the program include magnetic recording media such as hard disks and magnetic tapes, optical and magneto-optical storage media, non-volatile semiconductor memories, etc. Furthermore, a method for supplying the program may be a method in which the program according to the present invention is stored in a server on a computer network, and the program is downloaded to a client terminal that has sent a download request and executed.

[0078] <Additional Note> The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) A control device comprising: a generating means for generating first correction data for color / luminance adjustment based on an image of a color chart captured by a reference imaging device that is a reference for color / luminance adjustment and a target imaging device that is a target for color / luminance adjustment; and capable of applying the correction data to a target device; a setting means for setting a destination device; an acquisition means for acquiring second correction data to be combined with the first correction data; a combining means for combining third correction data using the first correction data and the second correction data; and applying means for applying the first correction data or the third correction data in accordance with the application destination device set by the setting means. (Configuration 2) The acquisition means 2. The control device according to configuration 1, wherein the second correction data is acquired from a device to which the second correction data has already been applied. (Configuration 3) the first correction data and the second correction data are a first table that associates input colors with output colors and a second table that is different from the first table, respectively; The synthesis means 3. The control device according to configuration 1 or 2, wherein the control device generates the third correction data, which is a table linking the output colors of the second table with the input colors of the first table. (Configuration 4) The control device according to configuration 1 or 2, further comprising a display means for displaying on a screen to allow a user to select whether or not to generate fourth correction data using correction data other than the first correction data. (Configuration 5) The display means further comprises: The control device according to configuration 4, wherein the other correction data is displayed on a screen so that the user can select the other correction data. (Configuration 6) The display means further comprises: The control device according to configuration 4, wherein a screen is displayed so that a user can select whether or not to apply the first correction data or the third correction data to the application destination device. (Configuration 7) The control device according to configuration 1 or 2, further comprising a notification unit that notifies a user, before applying the correction data to the destination device, of information indicating whether the correction data to be applied was generated by the combining means, and information indicating the correction data used in the generation process if the correction data was generated by the combining means. (Configuration 8) The setting means 3. The control device according to configuration 1 or 2, wherein the control device automatically sets the destination device in accordance with the priority of the device defined in the priority list. (Configuration 9) The setting means 3. The control device according to configuration 1 or 2, wherein the control device automatically sets a device to which the correction data that has already been applied has the highest correction accuracy as the application destination device. (method) A control method for a control device that includes a generation unit that generates first correction data for color and luminance adjustment based on captured images of a color chart captured by a reference imaging device that is a reference for color and luminance adjustment and a target imaging device that is a target for color and luminance adjustment, and that can apply the correction data to a target device, comprising: a setting step for setting a destination device; an acquisition step of acquiring second correction data to be combined with the first correction data; a combining step of combining third correction data using the first correction data and the second correction data; an application step of applying the first correction data or the third correction data in accordance with the destination device set in the setting step. (program) A program for causing a computer to execute a control method for a control device that includes a generation unit for generating first correction data for color and luminance adjustment based on captured images of a color chart captured by a reference imaging device that is a reference for color and luminance adjustment and a target imaging device that is a target for color and luminance adjustment, and that can apply the correction data to a target device, The control method includes: a setting step for setting a destination device; an acquisition step of acquiring second correction data to be combined with the first correction data; a combining step of combining third correction data using the first correction data and the second correction data; an application step of applying the first correction data or the third correction data in accordance with the destination device set in the setting step.

[0079] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications and variations are possible within the scope of the gist of the present invention. For example, the present invention can be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or recording medium, and having a computer processor in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions. [Explanation of symbols]

[0080] 10. Reference imaging device 20 Object Imaging Device 30 Display device 40 Control device 41 Control Unit 42 Communications Department 43 Memory 44 Display section 45 Operation section 46 Generation part 47 Synthesis section 48 Applicability determination section 49 Control Bus 500 Color Chart Patches 501-512

Claims

1. A control device including a generation unit that generates first correction data for color and brightness adjustment based on an image of a color chart captured by a reference imaging device that is a reference for color and brightness adjustment and a target imaging device that is a target for color and brightness adjustment, and that is capable of applying the correction data to a target device, a setting means for setting a destination device; an acquisition means for acquiring second correction data to be combined with the first correction data; a combining means for combining third correction data using the first correction data and the second correction data; an application unit that applies the first correction data or the third correction data in accordance with the application destination device set by the setting unit.

2. The acquisition means 2. The control device according to claim 1, wherein the second correction data is acquired from a device to which the second correction data has already been applied.

3. the first correction data and the second correction data are a first table that associates input colors with output colors and a second table that is different from the first table, respectively; The synthesis means 3. The control device according to claim 1, wherein the third correction data is a table in which the output colors of the second table and the input colors of the first table are linked.

4. 3. The control device according to claim 1, further comprising a display means for displaying on a screen to allow a user to select whether or not to generate fourth correction data using correction data other than the first correction data.

5. The display means further comprises:

5. The control device according to claim 4, wherein the other correction data is displayed on a screen so that the user can select the other correction data.

6. The display means further comprises:

5. The control device according to claim 4, wherein a screen is displayed so that a user can select whether or not the first correction data or the third correction data is to be applied to the application destination device.

7. The control device according to claim 1 or 2, further comprising a notification unit that notifies a user of information indicating whether the correction data to be applied was generated by the synthesis means before applying the correction data to the destination device, and information indicating the correction data used in the generation process if the correction data was generated by the synthesis means.

8. The setting means 3. The control device according to claim 1, wherein the control device automatically sets the application destination device in accordance with the priority of the device defined in the priority list.

9. The setting means 3. The control device according to claim 1, wherein the control device automatically sets a device to which the applied correction data has the highest correction accuracy as the application destination device.

10. A control method for a control device that includes a generation unit that generates first correction data for color and luminance adjustment based on captured images of a color chart captured by a reference imaging device that serves as a reference for color and luminance adjustment and a target imaging device that is a target for color and luminance adjustment, and that can apply the correction data to a target device, comprising: a setting step for setting a destination device; an acquisition step of acquiring second correction data to be combined with the first correction data; a combining step of combining third correction data using the first correction data and the second correction data; an application step of applying the first correction data or the third correction data in accordance with the destination device set in the setting step.

11. A program for causing a computer to execute a control method for a control device that includes a generation unit that generates first correction data for color and luminance adjustment based on captured images of a color chart captured by a reference imaging device that serves as a reference for color and luminance adjustment and a target imaging device that is a target for color and luminance adjustment, and that can apply the correction data to a target device, The control method includes: a setting step for setting a destination device; an acquisition step of acquiring second correction data to be combined with the first correction data; a combining step of combining third correction data using the first correction data and the second correction data; an application step of applying the first correction data or the third correction data in accordance with the destination device set in the setting step.

Images