Image correction apparatus, imaging system, control method, and program

Abstract

To provide an image correction apparatus which improves the accuracy of color matching between multiple cameras, an imaging system, a control method, and a program.SOLUTION: For color matching of imaging apparatuses A100, B200 by using images IMG_A, IMG_B of a pattern display image 50 on a display wall 500, the images being captured by the imaging apparatuses A100, B200, a control apparatus 300 stores a viewing angle correction value, on a memory 305, for correcting viewing angle characteristics generated depending on the positions of the imaging apparatuses A100, B200 with respect to a display screen of the display wall 500, so as to conform to predetermined viewing angle characteristics. A viewing angle characteristic correction unit 3023 applies a correction using the viewing angle correction value to the pattern display image 50 in the captured images IMG_A, IMG_B, to generate a plurality of corrected images. A color correction value calculation unit 3024 calculates a color correction value for matching colors of the corrected images.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an image correction apparatus, an imaging system, a control method, and a program, and more particularly to an image correction apparatus, an imaging system, a control method, and a program for performing color matching of a plurality of imaging devices that image a display device.

Background Art

[0002] In video production, imaging is usually performed using a plurality of cameras. However, due to individual differences in cameras, differences in lenses used, and differences in imaging conditions such as lighting environments, even for the same subject, the colors may differ between cameras. Therefore, the need for luminance and color matching (hereinafter referred to as color matching) between cameras is increasing.

[0003] In recent years, the use case of virtual production, which can create a video as if it were taken at the target location, has been expanding by using an LED display wall that arranges high-definition LED displays in the plane direction to form a large screen as the background.

[0004] In this use case, color matching is performed by displaying a color chart on the LED display wall at the site in addition to the color matching using a physical color chart in advance. The reason why color matching is performed not only on the physical object but also on the LED display wall is that due to differences in the characteristics of the color filters of the cameras, the LED display with peaks in the spectral characteristics is likely to show a color shift.

[0005] In addition, since imaging is performed using a plurality of cameras, there may be a camera that images the LED display wall obliquely, so adjustment is required according to the environment for each installation position of the camera.

[0006] Patent Document 1 discloses a technique for correcting image data by comparing an image of a subject with a re-image of a display device showing that image, calculating a correction amount based on the comparison result, and applying that correction amount to the image data.

[0007] Patent Document 2 describes adjusting the color balance of a projector's illumination light source by bringing the balance of the color signal values ​​obtained by capturing a reference image projected onto a reference screen closer to the balance of the color signal values ​​obtained by capturing a reference image projected onto a reference screen. [Prior art documents] [Patent Documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2002-135790 [Patent Document 2] Japanese Patent Publication No. 2012-68364 [Overview of the project] [Problems that the invention aims to solve]

[0009] However, the prior art described in Patent Documents 1 and 2 does not take into account the unevenness of color and brightness (viewing angle characteristics) that can be seen when viewing an LED display from an oblique angle, which leads to a problem of reduced accuracy in color matching between multiple cameras.

[0010] Therefore, the present invention aims to provide an image correction device, an imaging system, a control method, and a program that can improve the accuracy of color matching between multiple cameras. [Means for solving the problem]

[0011] To solve the above problems, the image correction device according to claim 1 of the present invention is an image correction device that displays a display image on a display screen of a display means and performs color matching of a plurality of imaging devices using a plurality of captured images generated by having a plurality of imaging devices capture the display image, and is characterized by comprising: a storage means that stores a field of view correction value for correcting the field of view characteristics caused by the positions of the plurality of imaging devices relative to the display screen of the display means to a predetermined field of view characteristics; a field of view characteristic correction means that generates a plurality of corrected images by applying the field of view correction value to the display image in the plurality of captured images; and a color correction value calculation means that calculates a color correction value for matching the colors of the plurality of corrected images.

[0012] To solve the above problems, the imaging system according to claim 12 of the present invention is an imaging system having a plurality of imaging devices, a display device, and an image correction device connected to them in a communicative manner, wherein each of the plurality of imaging devices comprises: an imaging means that generates an image by capturing a display image displayed on the display screen of a display means in response to a shooting instruction; a color and brightness correction means that applies correction to the image based on a color and brightness correction value; a first communication means that receives the shooting instruction, transmits the image, receives the color and brightness correction value, and retransmits the image after the correction has been applied, wherein the image correction device comprises: a storage means that stores a field of view correction value that corrects the field of view characteristics resulting from the position of the plurality of imaging devices relative to the display screen of the display means to a predetermined field of view characteristics; and after the display image is displayed on the display screen of the display means, the plurality of imaging devices The system is characterized by comprising: a second communication means that transmits a shooting instruction, receives a plurality of captured images transmitted from the plurality of imaging devices, transmits the color and brightness correction values ​​to the plurality of imaging devices, and receives a plurality of captured images retransmitted from the plurality of imaging devices; a field of view characteristic correction means that, upon receiving the plurality of captured images transmitted by the second communication means, applies correction to the plurality of captured images using the field of view correction value to generate a plurality of corrected images; a color correction value calculation means that calculates a color correction value to match the colors of the plurality of corrected images; a color and brightness correction value calculation means that calculates a color and brightness correction value to match the colors and brightness of the plurality of captured images using the color correction value and the field of view correction value; and a display instruction means that, upon receiving the plurality of retransmitted captured images by the second communication means, generates an image including the plurality of retransmitted captured images and instructs the display device to display the generated image. [Effects of the Invention]

[0013] According to the present invention, the accuracy of color matching between multiple cameras can be improved. [Brief explanation of the drawing]

[0014] [Figure 1]It is a configuration diagram of an imaging system using a display wall according to the first embodiment of the present invention. [Figure 2] It is a block diagram showing the hardware configuration of the imaging system in FIG. 1. [Figure 3] It is a diagram for explaining a method of applying color / brightness correction parameters, which are color / brightness correction values according to the first embodiment of the present invention, to a captured image. [Figure 4] It is a diagram for explaining the viewing angle characteristics according to the first embodiment of the present invention. [Figure 5] It is a diagram for explaining a color chart image used for color matching processing according to the first embodiment of the present invention. [Figure 6] It is a flowchart of a viewing angle correction value calculation process according to the first embodiment of the present invention. [Figure 7] It is a diagram for explaining a patch detection image for calculating a viewing angle correction value acquired by each imaging device according to the first embodiment of the present invention. [Figure 8] It is a flowchart of a color matching process according to the first embodiment of the present invention. [Figure 9] It is a diagram for explaining a color chart image detected from a captured image of each imaging device according to the first embodiment of the present invention. [Figure 10] It is a diagram showing a modification example of the arrangement of each imaging device according to the first embodiment of the present invention. [Figure 11] It is a configuration diagram of an imaging system using a projection device according to the second embodiment of the present invention.

Embodiments for Carrying Out the Invention

[0015] <First Embodiment> Hereinafter, the first embodiment of the present invention will be described.

[0016] A configuration diagram of the imaging system 1 according to this embodiment is shown in FIG. 1, and a block diagram of the hardware configuration of the imaging system 1 is shown in FIG. 2.

[0017] In Figure 1, the imaging system 1 consists of an imaging device A100 to which lens A10 is attached, an imaging device B200 to which lens B20 is attached, a control device 300, a display device 400, a display wall 500, a video controller 600, and a video output device 700.

[0018] As shown in Figure 2, the imaging device A100 outputs the captured image IMG_A to the control device 300. The imaging device A100 also receives the parameter PARAM_A from the control device 300 and sets the parameter PARAM_A in the image processing unit 103 within the imaging device A100 in order to perform color matching between imaging devices A100 and B200. As will be described in detail later, the color / luminance correction parameter (color / luminance correction value) is also one of the parameters belonging to parameter PARAM_A. The imaging device A100 also outputs imaging device information INFO_A to the control device 300. The imaging device information INFO_A includes the model number and serial number of the imaging device A100, the model number and serial number of the lens A10 attached to the imaging device A100, illumination light information, and imaging conditions, among other information related to the imaging device A100.

[0019] As shown in Figure 2, the imaging device A100 mounts the lens A10 via the mount A1.

[0020] Mount A1 is a mechanism for detachably attaching lens A10 to imaging device A100, and is equipped with electrical contacts for supplying power from imaging device A100 to lens A10 and for mutual communication between imaging device A100 and lens A10. Mount A1 is divided into a part belonging to imaging device A100 and a part belonging to lens A10, but for convenience, they are shown together in Figure 2.

[0021] Lens A10 is a lens mounted on the imaging device A100 via mount A1. As shown in Figure 2, light entering from lens A10 is received by sensor 101 in imaging device A100, and after A / D conversion by A / D conversion unit 102 and image processing by image processing unit 103, it becomes the captured image IMG_A. The imaging device A100 also controls the zoom and focus of lens A10.

[0022] As shown in Figure 2, the imaging device B200 outputs the captured image IMG_B to the control device 300. The imaging device B200 is also controlled based on the parameter PARAM_B received from the control device 300. The color and brightness correction parameters, which will be described in detail later, are also one of the parameters belonging to parameter PARAM_B and are set in the image processing unit 203 within the imaging device B200 for color matching between the imaging device B200 and the imaging device A100. The imaging device B200 also outputs imaging device information INFO_B to the control device 300. The imaging device information INFO_B includes information about the imaging device B200, such as the model number, serial number, model number of the lens B20 attached to the imaging device B200, and illumination light information.

[0023] As shown in Figure 2, the imaging device B200 mounts the lens B20 via the mount B1.

[0024] Mount B1 is a mechanism for detachably attaching lens B20 to imaging device B200, and is equipped with electrical contacts for supplying power from imaging device B200 to lens B20 and for mutual communication between imaging device B200 and lens B20. Mount B1 is divided into a part belonging to imaging device B200 and a part belonging to lens B20, but for convenience, it is shown together in Figure 2.

[0025] Lens B20 is a lens mounted on the imaging device B200 via mount B2. As shown in Figure 2, light entering through lens B20 is received by sensor 201 in imaging device B200, and after A / D conversion in A / D conversion unit 202 and image processing in image processing unit 203, it becomes the captured image IMG_B. The imaging device B200 also controls the zoom and focus of lens B20.

[0026] As shown in Figure 1, the control device 300 (image correction device) outputs image IMG_C to the display device 400. The control device 300 generates image IMG_C which includes the color-matched captured images IMG_A and IMG_B received from the imaging devices A100 and B200 respectively, as well as a menu for user control of the control device 300. Furthermore, as shown in Figure 2, based on the imaging device information INFO_A and INFO_B from the imaging devices A100 and B200 respectively, the control device 300 outputs parameters PARAM_A and PARAM_B, which include color and brightness correction parameters, to the imaging devices A100 and B200 respectively. In addition, the control device 300 outputs COMMAND_C to the video controller 600 for outputting the background image of the live-action image or CG image used for shooting as image IMG_E to the display wall 500 (display means). Furthermore, COMMAND_C may also include an instruction to superimpose a pattern display image 50 (display image) for color matching of imaging devices A100 and B200 onto image IMG_E and output it to the display wall 500.

[0027] The display device 400 displays the image IMG_C received from the control device 300. Users of the imaging system 1 can view the captured images IMG_A and IMG_B, respectively, taken by imaging devices A100 and B200, via the display device 400 after color matching has been performed.

[0028] The display wall 500 displays the image IMG_E received from the video controller 600. The display wall 500 is composed of multiple units, each having a resolution of 384 x 216. In this embodiment, the display wall 500 is described as curved, as shown in Figure 1, but this is not limited to this configuration. By capturing images of the display wall 500 and a subject in front of it using imaging devices A100 and B200, the user can create content that simulates the subject being photographed at a location of their choosing. In this embodiment, the multiple units constituting the display wall 500 are multiple LED display units, and the display wall 500 is constructed by arranging them vertically and horizontally in the planar direction, but this is not limited to this configuration. For example, the display wall 500 may be composed of panels such as organic EL or liquid crystal displays, or a rear projection device, instead of LEDs. Each unit of the Display Wall 500 has a correction processing unit (not shown) using a color matrix and 3D-LUT (Look Up Table), and is adjusted using a colorimeter and adjustment imaging devices A100 and B200 to match the color and brightness.

[0029] As shown in Figure 2, the video controller 600 receives a command COMMAND_C from the communication unit 304 of the control device 300, which instructs the display wall 500 to display an image. The video controller 600 generates a command COMMAND_D in response to the command COMMAND_C, which causes the image IMG_D to be sent, and transmits this to the video output device 700. Furthermore, the video controller 600 outputs the image IMG_D received from the video output device 700 to the display wall 500 as image IMG_E. In addition, the video controller 600 can superimpose a pattern display image 50 onto the image IMG_E (display image) output to the display wall 500 by command COMMAND_C from the control device 300. Note that the video controller 600 does not simply transmit the image IMG_D received from the video output device 700 as image IMG_E to be output to the display wall 500. Specifically, the video controller 600 generates images by dividing image IMG_D according to the resolution of the units that make up the display wall 500, and then assigns which unit to send each divided image to, resulting in image IMG_E. Image IMG_D may be the same resolution as the entire display wall 500, or it may be different. If it is different, the video controller 600 generates image IMG_E by scaling image IMG_D to generate an image of the same resolution, and then dividing image IMG_D.

[0030] The video output device 700 stores various content, and when it receives a predetermined content display instruction as command COMMAND_D from the video controller 600, it outputs the corresponding content as image IMG_D to the video controller 600. The video output device 700 is, for example, a video server or a mass storage device.

[0031] In this embodiment, an imaging system 1 that performs color matching between two imaging devices, imaging device A100 and imaging device B200, is described as an example. However, the number of imaging devices that perform color matching can be multiple, and may be two or more. In this embodiment, imaging devices A100 and B200 are imaging devices to which interchangeable lenses can be attached, but they may also be imaging devices with built-in lenses.

[0032] Next, the operation of each block of the imaging device A100, imaging device B200, and control device 300 will be explained in more detail using Figure 2. Note that since lens B20 has the same configuration as lens A10 and imaging device B200 has the same configuration as imaging device A100, a detailed explanation of lens B20 and imaging device B200 will be omitted.

[0033] Lens A10 comprises an imaging lens 11, a lens control unit 12, and a memory 13.

[0034] The imaging lens 11 has a drive unit (not shown) consisting of actuators and motors, and the drive unit drives the imaging lens 11 according to the control of the lens control unit 12. The actuators and motors of the imaging lens 11 move or operate the focusing lens, zoom lens, aperture, and image stabilization lens (not shown) that are part of the imaging lens 11.

[0035] The lens control unit 12 has a microcomputer (not shown) and controls the imaging lens 11 in accordance with control signals received from the imaging device control unit 108 through the mount A1.

[0036] Memory 13 is used as a storage device for various types of data used by the lens control unit 12.

[0037] The imaging device A100 comprises a sensor 101 (imaging means), an A / D conversion unit 102, an image processing unit 103, a display unit 104, a recording medium 105, a memory 106, an operation unit 107, an imaging device control unit 108, a communication unit 109, and an image output unit 110. In the imaging device A100, these are connected to a bus 111.

[0038] Sensor 101 is a photoelectric conversion device having multiple pixels. Sensor 101 converts the subject image formed by the imaging lens 11 in lens A10 into an analog electrical signal corresponding to the subject image using photoelectric conversion at each pixel.

[0039] The A / D conversion unit 102 converts the analog electrical signal output from the sensor 101 into a digital signal.

[0040] The image processing unit 103 applies various image processing to the digital signal output by the A / D conversion unit 102 to generate the captured image IMG_A. The image processing unit 103 performs so-called development processing, such as optical correction, which corrects the effect of the optical characteristics of the imaging lens 11 on the image, as well as pixel interpolation, luminance signal processing, and chrominance signal processing.

[0041] The captured image IMG_A generated by the image processing unit 103 is displayed on the display unit 104, recorded on a recording medium 105 such as a memory card, or output from the image output unit 110 to the image input unit 303 of the control device 300. The image processing unit 103 (color and brightness correction means) also applies color and brightness correction parameters between imaging devices A100 and B200 to the captured image IMG_A. The image output unit 110 (first communication means) retransmits the captured image IMG_A after this correction to the control device 300. Upon this retransmission, the control device 300 sends the image containing the corrected captured image IMG_A as image IMG_C to the display device 400.

[0042] The following explains how to apply color and brightness correction parameters to captured images IMG_A and IMG_B. Here, we will explain color and brightness correction using a 3D-LUT as an example. Figure 3 shows an example of a 3D-LUT to illustrate its overview. Here, the image before color and brightness conversion is explained as RGB8bit. A 3D-LUT is a table that associates specific RGB input values ​​with RGB output values ​​on a one-to-one basis. In Figure 3, Rin, Gin, and Bin represent the R, G, and B gradation values ​​before color and brightness conversion, respectively, while Rout, Gout, and Bout represent the R, G, and B gradation values ​​after color and brightness conversion, respectively. The 3D-LUT in Figure 3 is a table with 256 gradations (0 to 255) for each RGB and the input gradation changes in one step, resulting in a table consisting of approximately 16.77 million combinations (R256 × G256 × B256). For example, if the RGB values ​​of a certain pixel in the image before color and brightness correction are (Rin, Gin, Bin) = (0, 255, 255), then from the 3D-LUT in Figure 3, (Rout, Gout, Bout) = (13, 245, 252). The image processing unit 103 can obtain an image with converted color and brightness by applying the 3D-LUT in the manner described above to the RGB values ​​of each pixel that make up the image before color and brightness correction.

[0043] In the 3D-LUT shown in Figure 3, each of the RGB components has 256 gradations and 1 step. However, to save LUT size, a 3D-LUT consisting of 4096 combinations (R16 × G16 × B16) with 16 steps each may be used. In this case, input gradations other than those defined in the 3D-LUT can be converted by using existing techniques such as triangular pyramidal interpolation. Furthermore, while this embodiment presents a 3D-LUT as an example of a color and brightness correction method, it is not limited to this. For example, existing techniques such as 1D-LUTs or color matrices may be used as color and brightness correction methods, and several methods may be used in combination.

[0044] Returning to Figure 2, memory 106 is used as a processing buffer for the image processing unit 103 and as a storage device for programs executed by the imaging device control unit 108. Memory 106 is also used as a storage device for optical correction data in which optical correction values ​​used by the image processing unit 103 are defined, and as a storage device for GUI data such as menu screens displayed on the display unit 104 by the imaging device A100.

[0045] The control unit 107 is a group of input devices for the user to input instructions to the imaging device A100, including a power switch for turning the imaging device A100 on and off, an imaging switch for starting image recording, and selection / setting switches for configuring various menus.

[0046] The imaging device control unit 108 has a microcomputer and executes programs stored in the memory 106, performing operational control of the entire imaging system 1, including control of the image processing unit 103 and communication control with the lens A10.

[0047] The communication unit 109 has the function of communicating with other devices, such as LAN or USB, and communicates with the communication unit 304 of the control device 300. The communication unit 109 (first communication means) transmits imaging device information INFO_A to the control device 300 and receives parameter PARAM_A from the control device 300.

[0048] The image output unit 110 has a function to transmit the captured image IMG_A to other devices, such as LAN or HDMI (registered trademark), and outputs the captured image IMG_A to the image input unit 303 of the control device 300.

[0049] Bus 111 is connected to the A / D conversion unit 102, image processing unit 103, display unit 104, recording medium 105, memory 106, operation unit 107, imaging device control unit 108, communication unit 109, and image output unit 110, and facilitates the exchange of signals between each processing block.

[0050] The control device 300 comprises a control unit 301, a color matching processing unit 302, an image input unit 303, a communication unit 304, a memory 305, an operation unit 306, and an image output unit 307, all of which are connected to the bus 308.

[0051] The control unit 301 has a microcomputer and executes programs stored in the memory 305, performing overall operation control of the control device (image correction device), including control of the color matching processing unit 302 and communication control with the imaging devices A100 and B200, respectively.

[0052] The color matching processing unit 302 includes a pattern detection unit 3021, a viewing angle correction value calculation unit 3022, a viewing angle characteristic correction unit 3023, and a color correction value calculation unit 3024.

[0053] The pattern detection unit 3021 (pattern detection means) detects the pattern display image 50 displayed on the display wall 500 from the captured images IMG_A and IMG_B obtained by the imaging devices A100 and B100. Specifically, the pattern display image 50 can be detected using known techniques, such as detecting edges and vertices of the pattern display image 50 from the captured images IMG_A and IMG_B, or detecting markers superimposed on the pattern display image 50. In this embodiment, the pattern display image 50 is a color chart image (second pattern image) that includes multiple patch images, which will be described later, used to generate the color and brightness correction parameter LUT, as described later, and is displayed on the display wall 500. In addition, a white patch image (first pattern image), which is a uniform image of a specific color used for correcting the viewing angle characteristics, as described later, is displayed on the display wall 500 in the same area where the pattern display image 50 is displayed. Furthermore, as long as the pattern allows for the generation of color and brightness correction parameter LUTs and correction of viewing angle characteristics, the color chart image and white patch image described in this embodiment can be modified within the scope of the gist of this invention, regardless of the pattern shape and color.

[0054] Furthermore, if the detected pattern area is trapezoidal in shape, the pattern detection unit 3021 transforms it to a rectangular shape, for example, by projection transformation. Considering that the field of view correction value calculation unit 3022 will calculate the field of view correction value as described later, the pattern detection unit 3021 transforms the pattern areas acquired from imaging devices A100 and B200 to have the same resolution and aspect ratio. If the resolution of the detected pattern area is high, the pattern detection unit 3021 may further reduce the size of each pattern area while maintaining the same resolution and aspect ratio, depending on the calculation processing load.

[0055] The field of view correction value calculation unit 3022 (field of view correction value calculation means) calculates a correction value (field of view correction value) such that each pixel of the white patch image detected by the pattern detection unit 3021 has a predetermined brightness, in order to correct the field of view characteristics of the imaging devices A100 and B200. The field of view characteristic is a characteristic that arises from the position (field of view) of the imaging devices A100 and B200 relative to the display screen of the display wall 500. More specifically, in this embodiment, the field of view is the angle that indicates the deviation from the normal direction of the display screen of the display wall 500 (hereinafter simply referred to as "the normal direction of the display wall 500"). In this embodiment, the field of view characteristic is the brightness and color characteristics when the white patch image on the display screen of the display wall 500 is viewed at this field of view, and has brightness characteristics as shown in Figure 4. The horizontal axis shows the field of view in the horizontal direction. The vertical axis shows the brightness. In this embodiment, the horizontal field of view on the horizontal axis is defined as "+" to the right of the normal direction of the display wall 500 in Figure 1, and "-" to the left. Generally, viewing angle characteristics have the property that brightness and color become darker as the viewing angle increases. Figure 4 shows only the brightness characteristic of the viewing angle characteristics, but the same applies to the color characteristic. In this embodiment, for simplicity, a method for correcting viewing angle characteristics using only the brightness characteristic will be explained below, but the same applies to the color characteristic. Viewing angle characteristics also exist in the vertical direction, but the same concept applies to the vertical direction as to the horizontal direction, so the explanation will be omitted in this embodiment. As shown in Figure 4, when viewed from the normal direction of the display wall 500 (viewing angle is 0 degrees), the display brightness is 100%, so the white patch image A detected from the captured image IMG_A of the imaging device A100 located in this normal direction has a uniform brightness characteristic. On the other hand, when viewed from a direction shifted from this normal direction (viewing angle is a predetermined angle (≠0 degrees)), the display brightness is less than 100%, so the brightness of the white patch image B detected from the captured image IMG_B of the imaging device B200 located at a position shifted from this normal direction will be uneven. Therefore, the field of view correction value calculation unit 3022 calculates the field of view correction value so that the white patch image B has uniform characteristics.In other words, among the imaging devices A100 and B200, the imaging device with the smallest field of view is designated as the reference imaging device, and a field of view correction value is calculated so that the brightness distribution characteristics of white patch image B match those of white patch image A, in order to eliminate the field of view characteristics of the non-reference imaging device. If a pixel value in white patch image B is (R,G,B)=(128,128,128) and the pixel value at the same coordinate in white patch image A is (R,G,B)=(255,255,255), a field of view correction value is calculated by doubling R, G, and B for that pixel value. The field of view correction value calculation unit 3022 calculates the field of view correction value for all pixels of the detected white patch image.

[0056] The viewing angle characteristic correction unit 3023 (viewing angle characteristic correction means) applies a correction using the viewing angle characteristic correction value calculated by the viewing angle correction value calculation unit 3022 to the pattern area detected by the pattern detection unit 3021 in the color matching process described later.

[0057] The color correction value calculation unit 3024 (color correction value calculation means / color and luminance correction value calculation means) captures a pattern image for calculating color correction values ​​using imaging devices A100 and B200, respectively, and performs color matching processing using predetermined pixel values ​​within the area detected by the pattern detection unit 3021. Specifically in this embodiment, the color matching processing involves generating a color and luminance correction parameter LUT.

[0058] The color and brightness correction parameter LUT is generally generated using the color chart image shown in Figure 5. The color chart image in Figure 5 contains multiple patch images 501 to 512 with different colors. Based on this color chart image detected from the captured images IMG_A and IMG_B of imaging devices A100 and B200, a color and brightness correction parameter LUT is generated for color matching between the captured images IMG_A and IMG_B. In this embodiment, the imaging device with the smallest field of view among imaging devices A100 and B200 is designated as the reference imaging device, and the color correction value calculation unit 3024 sets the color and brightness correction parameter LUT for the non-reference imaging device. In this embodiment, the reference imaging device is imaging device A100, so the color correction value calculation unit 3024 sets the color and brightness correction parameter LUT for imaging device B200, which is the non-reference imaging device.

[0059] Specifically, first, patch images 501-512 included in the color chart image detected from the image IMG_A of the reference imaging device A100 are acquired as reference patch images. Next, patch images 501-512 included in the color chart image detected from the image IMG_B of the imaging device B200 are acquired, and each of these acquired patch images is corrected using the above field of view correction value. After that, a color correction parameter LUT (color correction value) is generated so that each corrected patch image is close to the color of the reference patch image. Furthermore, a color and luminance correction parameter LUT for color matching of imaging devices A100 and B200 is generated using the color correction parameter LUT and the above field of view correction value.

[0060] In this embodiment, the imaging system 1 used consists of two imaging devices, A100 and B200, but it may also consist of three or more. For example, if the imaging system 1 uses N imaging devices, the number of non-reference imaging devices will be (N-1), and (N-1) color and brightness correction parameter LUTs will be generated.

[0061] The shape of the color chart and the number of patches are not limited to those described above. Increasing the number of patches allows for more detailed acquisition of color information from imaging devices A100 and B200, but this also increases the load on the correction parameter LUT generation process, resulting in a trade-off. The color and brightness correction parameter LUTs that can be generated using the above method may be generated each time the imaging conditions are changed. Changes in imaging conditions include, for example, changing the lens attached to the non-imaging device, changing the color temperature of the lighting environment, replacing the non-imaging device, or changing parameters such as the iris of the reference imaging device. The color and brightness correction parameter LUTs generated under each imaging condition are stored in memory 305.

[0062] The image input unit 303 (second communication means) has an image input interface such as LAN or HDMI, and acquires the captured image IMG_A transmitted or retransmitted from the image output unit 110 of the imaging device A100. Similarly, the image input unit 303 acquires the captured image IMG_B transmitted or retransmitted from the image output unit 210 of the imaging device B200.

[0063] The communication unit 304 (second communication means) has the function of communicating with other devices such as LAN and USB, and communicates with the communication unit 109 of the imaging device A100, the communication unit 209 of the imaging device B200, and the communication unit (not shown) of the video controller 600. For example, if the reference imaging device for color and brightness correction is imaging device A100, the communication unit 304 transmits the color and brightness correction parameter LUT determined by the color correction value calculation unit 3024 to imaging device B200 as PARAM_B. Other signals that the communication unit 304 transmits and receives from imaging devices A100 and B200, respectively, have been described in the explanation of the communication unit 109 of imaging device A100 and will be omitted here. The communication unit 304 transmits the command COMMAND_C to the video controller 600, which instructs the background image to be displayed on the display wall 500 and the superimposition of the pattern display image 50 used for the viewing angle correction value calculation process and color matching process described later. In this embodiment, the control device 300, imaging devices A100 and B200, and video controller 600 are connected to each other in a way that allows them to communicate with one another. The connection here can be either a wired connection such as USB or LAN, or a wireless connection such as Wi-Fi, as long as the devices can communicate with each other and exchange information.

[0064] Memory 305 (storage means) is used as a storage device for various processing buffers, programs executed by the control unit 301, and color and brightness correction parameters as shown in Figure 4. Memory 305 is also used as a storage device for GUI data such as menu screens that the control device 300 displays on the display device 400 via the image output unit 307. In addition, information received from imaging device A100 and imaging device B200 is stored in memory 305.

[0065] The operation unit 306 is a group of input devices for the user to input instructions to the control device 300, including a power switch for turning the control device 300 on and off, and a switch for initiating the adaptation and updating of color and brightness correction parameters to a non-reference imaging device.

[0066] The image output unit 307 has the function of transmitting images to other devices via, for example, SDI or HDMI, and outputs the image IMG_C to the display device 400.

[0067] Next, a method for improving the accuracy of color matching by removing the viewing angle characteristics of the display wall 500 from the color chart image detected from the captured images of the reference imaging device and the non-reference imaging device, respectively, which is a feature of this embodiment, will be explained using Figures 6 to 10.

[0068] <Basic operation> Figure 6 is a flowchart of the field of view correction value calculation process. This process starts when the user selects to perform color matching by operating the control unit 306 of the control device 300 on a GUI (not shown) displayed on the display device 400. This process is executed when the control unit 301 of the control device 300 (image correction device) reads the program stored in the memory 305 and loads it into RAM (not shown).

[0069] In step S601, a command COMMAND_C is output to the video controller 600 via the communication unit 304, instructing it to display image IMG_E, which is an image with a white patch image superimposed on the display wall 500. Upon receiving command COMMAND_C, the video controller 600 generates image IMG_E by superimposing the white patch image onto the area of ​​the pattern display image 50 of image IMG_D received from the video output device 700. Subsequently, the video controller 600 transmits image IMG_E and an instruction to display it to the display wall 500. The resolution of the pattern display image 50 superimposed on image IMG_D should be the resolution of one of the multiple LED display units that make up the display wall 500. This is because each LED display unit that makes up the display wall 500 has different characteristics, and if the resolution is higher than this, differences in brightness and color may occur at the boundaries of the LED display units, potentially reducing the accuracy of the color matching process described later. However, this does not apply if, due to the arrangement of imaging devices A100 and B200, setting the resolution of the pattern display image 50 superimposed on image IMG_D as described above would prevent color matching processing.

[0070] In step S602, a capture command, which instructs the imaging devices A100 and B200 to capture the pattern display image 50 (white patch image) displayed on the display wall 500, is transmitted via the communication unit 304.

[0071] In step S603, the system waits until it receives the captured images IMG_A and IMG_B from imaging devices A100 and B200, respectively. Once the captured images IMG_A and IMG_B are received, the system proceeds to step S604. If the captured images IMG_A and IMG_B are not received after a predetermined time has elapsed, the system times out and the image output unit 307 may output an error message superimposed on the image IMG_C to the display device 400.

[0072] In step S604, the pattern detection unit 3021 (first image detection means) detects the area where the white patch image is displayed from the respective captured images IMG_A and IMG_B from imaging devices A100 and B200 acquired in step S603. If the white patch image is detected in both captured images IMG_A and IMG_B (YES in step S604), the process proceeds to step S605. On the other hand, if the white patch image is not detected in at least one of the captured images IMG_A and IMG_B (NO in step S604), the process returns to step S602, and the shooting instruction command is sent again to imaging devices A100 and B200. At this time, an error message indicating that the white patch image could not be detected may be superimposed on image IMG_C and output to the display device 400.

[0073] In step S605, the field of view correction value calculation unit 3022 acquires luminance distribution information for the white patch image region of the pattern display image 50 detected in step S604, thereby detecting luminance unevenness within the region of the pattern display image 50. For example, the white patch image region of the pattern display image 50 detected from the captured image IMG_B of imaging device B200 has the luminance distribution shown in the patch detection image 701 in Figure 7(a). On the other hand, the white patch image region of the pattern display image 50 detected from the captured image IMG_A of imaging device A100 has the luminance distribution shown in the patch detection image 702 in Figure 7. As shown in Figure 7(b), if imaging device B200 is capturing the pattern display image 50 from the right side relative to the normal direction of the display surface of the display wall 500, it is assumed that it is capturing on the positive angle side of the field of view characteristics shown in Figure 4. The field of view angle 703 with respect to the left edge of the pattern display image 50 is the angle with respect to the normal 706 of its display position. The field of view angle 704 relative to the center of the pattern display image 50 is the angle with respect to the normal vector 707 of its display position. The field of view angle 705 relative to the right edge of the pattern display image 50 is the angle with respect to the normal vector 708 of its display position. In Figure 7(b), the size of the field of view angles is such that field of view angle 703 < field of view angle 704 < field of view angle 705. Therefore, the image of the white patch image region detected from the image captured by imaging device B200 IMG_B (patch detection image 701) becomes darker towards the right side of the region. The luminance distribution is obtained, for example, in the form of pixel values ​​(R, G, B). Similarly, the image of the white patch image region detected from the image captured by imaging device A100 IMG_A (patch detection image 702) has a uniform luminance distribution. As shown in Figure 7(b), when the imaging device A100 is capturing images from the normal direction of the display wall 500, the brightness of the patch detection image 702 will be the brightness of 0° in the field of view characteristic of Figure 4, resulting in an image without brightness unevenness, as shown in the patch detection image 702.

[0074] Depending on the shape of the display wall 500, the brightness distribution will differ when the display wall 500 is photographed from an oblique angle, as with the imaging device B200. For example, if the display wall 500 is flat, the relationship between the field of view angles 703 and 705 will change, and the brightness distribution of the patch detection image 701 will be different from the brightness distribution shown in Figure 7(a).

[0075] In step S606, the field of view correction value calculation unit 3022 calculates the field of view correction value for patch detection image 701 based on the luminance distribution information of patch detection image 701 and patch detection image 702 acquired in step S605. The field of view correction value is calculated for all pixels. That is, a field of view correction value is calculated that matches the luminance distribution of all pixels in patch detection image 701 with the luminance distribution of patch detection image 702, which has a uniform luminance distribution. The calculated field of view correction value is stored in memory 305 (storage means).

[0076] This completes the process shown in Figure 6.

[0077] In this embodiment, when calculating the field of view correction value, a field of view correction value was calculated such that the luminance distribution of patch detection image 701 becomes the luminance distribution of patch detection image 702. However, other calculation methods are acceptable as long as they are within the scope of the gist of this invention.

[0078] For example, the imaging device A100 does not have to be positioned in the direction normal to the display wall 500 as shown in Figure 7(b). In this case, the patch detection image 702 acquired from imaging device A100 will not have the uniform brightness distribution shown in Figure 7(a), but will be an image with brightness unevenness like the patch detection image 701 shown in Figure 7(a). In other words, it is sufficient to correct the brightness unevenness due to the viewing angle characteristics, and the position of each imaging device in the imaging system 1 is not particularly limited. For example, in this case, the viewing angle correction values ​​for the patch detection images 701 and 702 detected from the respective captured images IMG_A and IMG_B of imaging devices A100 and B200 may be calculated relative to a reference image that is uniform in a specific color. Here, uniform in a specific color means that the gradation values ​​within the reference image are uniform. In other words, the reference image can be considered equivalent to the patch detection image taken from the direction normal to the display wall 500 (the position where the viewing angle is 0 degrees).

[0079] Figure 8 is a flowchart of the color matching process. This process is executed immediately after the viewing angle correction value calculation process in Figure 6 is completed. This process is executed when the control unit 301 of the control device 300 reads the program stored in the memory 305 and loads it into RAM (not shown).

[0080] Furthermore, a button to start calculating the viewing angle correction value may be provided separately from the button to start color matching on the GUI (not shown) displayed on the display device 400. In this case, if the button to start calculating the viewing angle correction value is selected by the user, the viewing angle correction value calculation process shown in Figure 6 will start, and if the button to start color matching is selected by the user, the color matching process shown in Figure 8 will start.

[0081] In step S801, a command COMMAND_C is output to the video controller 600 via the communication unit 304, instructing it to display image IMG_E, which is an image with a color chart image superimposed on it, on the display wall 500. Upon receiving command COMMAND_C, the video controller 600 first generates image IMG_E by superimposing the pattern display image 50 (color chart image) onto image IMG_D, which was received from the video output device 700. Subsequently, the video controller 600 transmits image IMG_E and an instruction to display it to the display wall 500. The resolution of the color chart image superimposed on image IMG_D in step S801 is set to the same resolution as the white patch image superimposed on image IMG_D in step S601.

[0082] In step S802, a shooting instruction command, which is an instruction to take a picture of the pattern display image 50 (color chart image) displayed on the display wall 500, is transmitted to the imaging device A100 and the imaging device B200 respectively via the communication unit 304 (second communication means).

[0083] In step S803, the system waits until it receives the captured images IMG_A and IMG_B from imaging devices A100 and B200, respectively. When the captured images IMG_A and IMG_B are received, the system proceeds to step S604. If the captured images IMG_A and IMG_B are not received after a predetermined time has elapsed, the system times out, and the image output unit 307 may output an error message superimposed on the image IMG_C to the display device 400.

[0084] In step S804, the pattern detection unit 3021 (second image detection means) detects the display area of ​​the pattern display image 50 (color chart image) from the captured images IMG_A and IMG_B, respectively, acquired in step S803 from imaging devices A100 and B200. If the color chart image cannot be detected in at least one of the captured images IMG_A and IMG_B, the process returns to step S802, and the shooting instruction command is sent again to the imaging device that sent the image in which the color chart image could not be detected. At this time, an error message indicating that the color chart image could not be detected may be superimposed on image IMG_C and output to the display device 400.

[0085] The color chart image detected in step S804 is shown in Figure 9.

[0086] Color chart image 901 is a color chart image detected from the image IMG_B captured by imaging device B200, and shows a luminance distribution that becomes darker towards the right in Figure 9. This is because imaging device B200 is located to the right of the normal direction of the display wall 500 in Figure 1 (a position where the viewing angle is greater than 0 degrees), and therefore, due to the viewing angle characteristics in Figure 4, the luminance of the display wall 500 as seen from imaging device B200 appears darker towards the right. The luminance distribution is acquired, for example, in the form of pixel values ​​(R, G, B).

[0087] The color chart image 902 is a color chart image detected from the image IMG_A captured by the imaging device A100, and it has a uniform brightness distribution. This is because, as shown in Figure 1, the imaging device A100 is located on the normal direction of the display wall 500 (at a viewing angle of 0 degrees), and therefore, due to the viewing angle characteristics in Figure 4, the display wall 500 as seen from the imaging device A100 appears to have 100% brightness without any brightness unevenness.

[0088] In step S805, the viewing angle characteristic correction unit 3023 applies the viewing angle correction value calculated in step S606 and stored in memory 305 to the color chart image 901 detected in step S804, generating a color chart image 903 (corrected image). In this embodiment, the viewing angle correction value obtained in step S606 was determined to correct the patch detection image 701 shown in Figure 7 to be closer to the patch detection image 702. Therefore, when the viewing angle correction value is applied to the color chart image 901, a color chart image 903 (Figure 9) is generated. This correction removes the viewing angle characteristics of the captured image due to the position of the imaging device relative to the normal direction of the display wall 500. However, the color chart image 903 still retains color differences in each color patch due to individual differences in the lens of the imaging device B200. Since there are no viewing angle characteristics to remove in the color chart image 902, the viewing angle characteristic correction unit 3023 generates the color chart image 902 itself as the corrected image. However, if the color chart image 902 has viewing angle characteristics that should be removed, and the viewing angle correction value for those characteristics has been calculated in step S606, then a corrected image will be generated in the same way as the color chart image 901.

[0089] In step S806, the color correction value calculation unit 3024 obtains the gradation values ​​of each color patch in the color chart image 902 detected in step S804 and the color chart image 903 generated in step S805. Since the coordinates of each color patch are predetermined, it is sufficient to read the gradation value of a specific coordinate value. At this time, if only one pixel of each color patch is extracted, the gradation value may vary due to the influence of imaging noise, so multiple pixels are acquired and the average value is used. In this embodiment, as shown in the color chart image of Figure 5, there are 12 color patches, so the gradation values ​​of the 12 color patches are obtained from the color chart images 902 and 903 respectively in step S806.

[0090] In step S807, a color correction parameter LUT (color correction value) is generated to match the colors of color chart images 902 and 903, using the gradation values ​​of each color patch obtained in step S806 from color chart images 902 and 903, respectively. Subsequently, a color and brightness correction parameter LUT (color matching) is generated to match the color and brightness between imaging devices A100 and B200, based on the color correction parameter LUT and the field of view correction value stored in memory 305 in step S606. The generation of the color and brightness correction parameter LUT is as described above.

[0091] Subsequently, the control unit 301 generates parameters PARAM_A and PARAM_B based on the generated color / luminance correction parameter LUT and imaging device information INFO_A and INFO_B, and transmits them to imaging devices A100 and B200 via the communication unit 304. When imaging device A100 receives parameter PARAM_A via the communication unit 109, the image processing unit 103 (color correction means) first applies a correction to the captured image IMG_A using parameter PARAM_A. Next, the image output unit 110 (first communication means) retransmits the corrected captured image IMG_A to the control device 300. When imaging device B200 receives parameter PARAM_B, the same process is performed, and the corrected captured image IMG_B is retransmitted to the control device 300. When the control unit 301 (display instruction means) receives the corrected captured images IMG_A and IMG_B, it generates an image containing these images as image IMG_C and transmits it to the display device 400, thereby instructing the display device 400 to display image IMG_C.

[0092] This completes the process shown in Figure 8.

[0093] In this embodiment, color matching of multiple imaging devices with different viewing angles to the display wall 500 is performed after correcting the color chart images displayed on the display wall 500, which were captured by the multiple imaging devices, with a viewing angle correction value to remove the viewing angle characteristics. This improves the accuracy of color matching.

[0094] In this embodiment, the imaging device A100 was positioned in the direction normal to the display wall 500, but the embodiment is not limited to this particular one. For example, as shown in Figure 10, the imaging device A100 may be positioned at a field of view angle of 150 with respect to the direction normal to the display wall 500, and the imaging device B200 may be positioned at a field of view angle of 250 with respect to the direction normal to the display wall 500. In this case, instead of calculating the field of view correction value using the reference image described above, the reference imaging device for color matching may be the imaging device A100, which has the smallest deviation (field of view angle) from the direction normal to the display wall 500. In this case, the field of view correction value may be calculated so that the luminance distribution of the white patch image in the image IMG_B captured by imaging device B200 approaches the luminance distribution of the white patch image in the image IMG_A captured by imaging device A100. Alternatively, the field of view angle 150 of imaging device A100 and the field of view angle 250 of imaging device B200, as shown in Figure 10, may be measured using known measuring means (angle detection means), and the field of view angle correction value may be calculated based on the field of view angle characteristics shown in Figure 4, which are stored in advance in memory 305 (holding means).

[0095] Furthermore, it is desirable that the display position of the pattern display image 50 on the display wall 500 not be changed each time the pattern display image 50 is captured by the imaging devices A100 and B200, respectively. Since the display wall 500 is composed of multiple LED display units, the characteristics of the LEDs differ depending on the location. Therefore, if the display position of the pattern display image 50 is changed when imaging devices A100 and B200 capture images, differences in color and brightness between cameras will occur due to the characteristics of the LEDs, in addition to the viewing angle characteristics and camera characteristics, which may reduce the accuracy of color matching. In addition, although this embodiment has described the case where the display position of the pattern display image 50 is in the center of the display wall 500, the display position of the pattern display image 50 may be in a different location as long as it is included within the field of view of the imaging device. It is desirable to display the pattern display image 50 on the LED display unit that is most often included within the field of view when creating content in which the user places the subject in front of the display wall 500 and takes a photograph.

[0096] Furthermore, in this embodiment, the viewing angle correction value was calculated using only the luminance characteristics, but it may also be calculated using the color characteristics. In this case, similar to the luminance distribution with respect to the viewing angle shown in Figure 4, the color distribution with respect to the viewing angle can be obtained and the viewing angle correction value can be calculated.

[0097] <Second Embodiment> A second embodiment of the present invention will now be described. In this embodiment, the same numbering will be used for components identical to those in the first embodiment, and redundant explanations will be omitted.

[0098] Figure 11 shows a diagram of the configuration of the imaging system 1' according to this embodiment.

[0099] In Figure 11, the imaging system 1' according to the second embodiment consists of an imaging device A100 to which lens A10 is attached, an imaging device B200 to which lens B20 is attached, a control device 300, a display device 400, a projection device 800, and a screen 900 (display means).

[0100] In the first embodiment, an imaging system 1 was constructed using a display wall 500, but as in this embodiment, a similar imaging system can be constructed using a projection device 800 and a screen 900.

[0101] The projection device 800 either displays an image that has been pre-deformed by the image output unit 307, or displays an image that has been deformed by a deformation processing unit (not shown) within the projection device 800, so that the projected image does not extend beyond the screen 900.

[0102] The display position of the pattern display image 50 on the screen 900 is the same as the display position of the pattern display image 50 on the display wall 500 in the first embodiment, so no explanation is provided.

[0103] The screen 900, like the display wall 500, has viewing angle characteristics. The display wall 500 has a display brightness of 100% in the direction normal to its surface. However, in the case of the screen 900, the light from the projection device 800 is reflected by the screen 900 and enters the user's eyes, so the display brightness in the direction normal to the display surface of the screen 900 (hereinafter simply referred to as "the normal direction of the screen 900") is not 100%. That is, the display brightness of the screen 900 is 100% in the direction of the emission angle of light from the screen 900, which is symmetrical to the incidence angle of light from the projection device 800 with respect to the normal direction of the screen 900. In other words, the direction of the emission angle of light from the screen 900 can be replaced with the direction of 0° in the viewing angle characteristic graph in Figure 4.

[0104] Other than the above, the description is the same as in the first embodiment, so we will omit further explanation.

[0105] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Some of the above embodiments may be combined as appropriate.

[0106] Furthermore, the present invention also includes cases in which a software program that realizes the functions of the above-described embodiment is supplied directly from a recording medium or via wired / wireless communication to a system or device having a computer capable of executing the program, and the program is executed.

[0107] Therefore, in order to implement the functional processing of the present invention on a computer, the program code supplied to and installed on the computer itself also realizes the present invention. In other words, the computer program itself for realizing the functional processing of the present invention is also included in the present invention.

[0108] In that case, the form of the program is irrelevant, as long as it possesses the functionality of a program, including object code, programs executed by an interpreter, and script data supplied to the OS.

[0109] The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory.

[0110] Another possible method for supplying the program is to store the computer program forming the present invention on a server on a computer network, and then have connected client computers download and run the computer program. [Explanation of Symbols]

[0111] 50 Pattern Display Images 100 Imaging device A 200 Imaging device B 300 Control device 302 Color Matching Processing Unit 3021 Pattern detection unit 3022 Field of View Correction Value Calculation Unit 3023 Viewing Angle Characteristic Correction Unit 3024 Color Correction Value Calculation Unit 400 display device 500 Display Wall 600 Video Controller 700 Video output device 800 Projection device 900 screens

Claims

1. 1. An image correction device that displays a display image on a display screen of a display means, and performs color matching of a plurality of image capture devices using a plurality of captured images generated by capturing the display image using a plurality of image capture devices, a storage means for storing a viewing angle correction value used for correcting a viewing angle characteristic caused by the positions of the plurality of imaging devices with respect to a display screen of the display means so as to become a predetermined viewing angle characteristic; a viewing angle characteristic correction means for correcting the display images of the plurality of captured images using the viewing angle correction value to generate a plurality of corrected images; a color correction value calculation means for calculating a color correction value used to match the colors of the plurality of corrected images; An image correction device comprising:

2. a first image detection means for detecting the first pattern image from a plurality of other captured images generated by causing the plurality of image capturing devices to capture images after displaying a first pattern image in an area of ​​the display means where the display image is displayed; a view angle correction value calculation means for calculating the view angle correction value to be stored in the storage means from the first pattern images detected by the first image detection means from the other captured images; a second image detection means for detecting the second pattern image from the plurality of captured images generated by causing the plurality of imaging devices to capture images after the second pattern image is displayed on the display means as the display image, The image correction device according to claim 1, characterized in that the second pattern images detected by the second image detection means from the plurality of captured images are corrected with the viewing angle correction value by the viewing angle characteristic correction means, and the color correction value calculation means generates the plurality of corrected images used for calculating the color correction value.

3. 3. The image correction device according to claim 2, wherein the first pattern image is a uniform image of a specific color, and the second pattern image is a color chart image in which one or more patch images of different colors are arranged.

4. 4. The image correction device according to claim 3, wherein the viewing angle correction value is a correction value used to make uniform at least one of the luminance and color of each pixel of the first pattern image detected by the first image detection means.

5. Among the plurality of imaging devices, an imaging device having a smallest viewing angle with respect to the display screen of the display means is defined as a reference imaging device; 4. The image correction device according to claim 3, wherein the viewing angle correction value is a correction value used to make a distribution characteristic consisting of at least one of luminance and color of each of the first pattern images detected by the first image detection means coincide with the distribution characteristic of the first pattern image detected by the first image detection means from the image captured by the reference imaging device.

6. 6. The image correction device according to claim 5, wherein the color correction value is a correction value used to match the colors of the plurality of correction images to the colors of a correction image generated by the viewing angle characteristic correction means from an image captured by the reference imaging device.

7. 4. The image correction device according to claim 3, wherein the viewing angle correction value is a correction value used to make a distribution characteristic consisting of at least one of luminance and color of each of the first pattern images detected by the first image detection means coincide with the distribution characteristic of the first pattern image obtained by imaging in advance from a position where the viewing angle with respect to the display screen of the display means is 0 degrees.

8. A holding means for holding the viewing angle characteristic; an angle detection unit that detects a viewing angle of each of the plurality of imaging devices with respect to the display screen of the display unit, 3. The image correction device according to claim 2, wherein the viewing angle correction value calculation means calculates the viewing angle correction value based on the viewing angle characteristic stored in the storage means and corresponding to the detected viewing angle.

9. 3. The image correction device according to claim 2, wherein the position of the displayed image on the display screen of the display means is not changed for each image captured by the plurality of image capturing devices.

10. 10. The image correction device according to claim 1, wherein the display means is a display wall made up of a plurality of LED display units.

11. 10. The image correction device according to claim 1, wherein the display means is a screen on which the display image projected by a projection device is displayed.

12. An imaging system having a plurality of imaging devices, a display device, and an image correction device communicatively connected to the imaging devices, In each of the plurality of imaging devices, an imaging means for capturing an image displayed on a display screen of the display means in response to a shooting instruction to generate a first captured image; a color / luminance correction unit that performs correction on the generated first captured image based on a color / luminance correction value; each of the plurality of imaging devices includes a first communication means for receiving the image capture instruction, transmitting the first captured image, receiving the color / luminance correction value, and transmitting a second captured image obtained by performing the correction on the first captured image to the image correction device; Equipped with In the image correction device, a storage means for storing a viewing angle correction value used for correcting a viewing angle characteristic caused by positions of the plurality of imaging devices with respect to the display screen of the display means so as to become a predetermined viewing angle characteristic; a second communication means for transmitting the image capturing instruction to the plurality of image capturing devices, receiving the plurality of first captured images transmitted from the plurality of image capturing devices, transmitting the color / luminance correction values ​​to the plurality of image capturing devices, and receiving the plurality of second captured images transmitted from the plurality of image capturing devices, after the display image is displayed on the display screen of the display means; a viewing angle characteristic correction means for correcting the first captured images using the viewing angle correction value when the first captured images are received, to generate a plurality of corrected images; a color correction value calculation means for calculating a color correction value used to match the colors of the plurality of corrected images; a color / luminance correction value calculation means for calculating a color / luminance correction value used to adjust colors / luminances of the plurality of first captured images by using the color correction value and the viewing angle correction value; a display instruction means for generating an image including the second captured images when the second captured images are received by the second communication means from the imaging devices, and for transmitting an instruction to display the generated image to the display device; An imaging system comprising:

13. 1. A method for controlling an image correction device, comprising the steps of: performing color matching of a plurality of imaging devices using a plurality of captured images generated by capturing an image displayed on a display screen of a display means, the method comprising the steps of: a storage step of storing a viewing angle correction value used for correcting a viewing angle characteristic caused by positions of the plurality of imaging devices with respect to a display screen of the display means so as to become a predetermined viewing angle characteristic; a viewing angle characteristic correcting step of correcting the display image of the plurality of captured images using the viewing angle correction value to generate a plurality of corrected images; a color correction value calculation step of calculating a color correction value used to match colors of the plurality of corrected images; A control method comprising the steps of:

14. A computer-executable program that causes a computer to function as each step of the image correction device according to any one of claims 1 to 11.

Images