Color adjustment method, projector and program

Abstract

To provide a color adjustment method for reducing a difference in colors of images projected by a plurality of projectors.SOLUTION: A control section 150A of a first projector 100A is configured to: execute automatic color adjustment processing for determining, based on imaging results of a first image and projected by the first projector 100A and a second image projected by a second projector 100B, a first correction value used to correct a color of the first image; execute manual color adjustment processing for accepting operation of correcting the color of a third image projected by the first projector 100A, the third image being obtained by correcting the first image with the first correction value, and determining, based on a result of the operation, a second correction value used to correct the color of the third image; update the first correction value by re-executing first processing when a preset setting condition is satisfied; and output the first correction value updated by re-executing the first processing, and the second correction value.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a color adjustment method, a projector, and a program. [Background technology]

[0002] A method is known in which images projected by a plurality of projectors are adjusted based on images captured by a camera. For example, Patent Document 1 discloses a control method for a display system including a first projector and a first imaging device communicably connected to the first projector and configured to capture a first projection image of the first projector. This control method for a display system includes a first generation step, a second generation step, a third generation step, and a correction step. In the first generation step, the first projector projects a test pattern in a reference state in which the projection conditions of the first projector are adjusted so that the color of the first projected image when viewed from the front is a desired color, and the first imaging device captures the first projected image corresponding to the test pattern. This generates a captured image as a reference image. In the second generation step, when performing color readjustment of the first projection image, the first projector projects a test pattern, and the first imaging device captures the first projection image corresponding to the test pattern to generate a captured image as a comparison image. The third generating step generates a correction value for correcting the projection conditions so that the comparative image coincides with the reference image. The correction step corrects the projection conditions based on the correction value. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-182695 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when correcting the colors of images projected by multiple projectors using images captured by a camera, even if the captured images show the same color, the human eye may see the colors as different colors. For this reason, it was necessary to adjust the colors manually after adjusting the colors using the images captured by the camera. [Means for solving the problem]

[0005] The present disclosure relates to a color adjustment method including: performing a first process for determining a first correction value to be used when correcting a color of a first image projected by a first projector and a second image projected by a second projector based on an imaging result of the first image and a second image projected by a second projector; performing a second process for a third image obtained by correcting the first image using the first correction value, the third image being obtained by correcting the first image using the first correction value, the second process including accepting a first operation for correcting the color of the third image projected by the first projector and determining a second correction value to be used when correcting the color of the third image based on a result of the first operation; updating the first correction value by re-executing the first process when a preset setting condition is met; and outputting the first correction value and the second correction value updated by re-executing the first process.

[0006] The present disclosure relates to a projector that includes an optical device, an imaging device, and at least one processor, wherein the at least one processor executes the following: performing a first process to determine a first correction value to be used when correcting a color of a first image projected by the optical device and a second image projected by another projector based on imaging results of the first image and a second image projected by another projector; accepting a first operation to correct the color of the third image projected by the optical device, the third image being a third image obtained by correcting the first image using the first correction value; performing a second process to determine a second correction value to be used when correcting the color of the third image based on a result of the first operation; updating the first correction value by re-executing the first process when a preset setting condition is met; and outputting the first correction value and the second correction value updated by re-executing the first process.

[0007] The present disclosure is a program that causes a computer to execute a first process to determine a first correction value to be used when correcting a color of a first image projected by a first projector and a second image projected by a second projector based on imaging results of the first image and a second image projected by a second projector; accepting a first operation to correct the color of the third image projected by the first projector, the third image being a third image obtained by correcting the first image with the first correction value; executing a second process to determine a second correction value to be used when correcting the color of the third image based on a result of the first operation; updating the first correction value by re-executing the first process when a preset setting condition is met; and outputting the first correction value and the second correction value updated by re-executing the first process. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration according to an embodiment. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of a projector. [Diagram 3] FIG. 4 is a diagram showing an example of an operation screen. [Figure 4] 6 is a flowchart showing the operation of the first projector. [Diagram 5] 4 is a flowchart showing an automatic color adjustment process. [Figure 6] 4 is a flowchart showing a manual color adjustment process. [Figure 7] 6 is a flowchart showing the operation of the first projector when projecting an image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] [1. System configuration] FIG. 1 is a diagram showing an example of a system configuration of the present embodiment. FIG. 1 shows an X-axis, a Y-axis, and a Z-axis which are perpendicular to each other. The Z-axis indicates the vertical direction. The X-axis and the Y-axis are parallel to the horizontal direction. The X-axis indicates the left-right direction, and the Y-axis indicates the front-back direction. The positive direction of the X-axis indicates the right direction when facing the screen SC, the positive direction of the Y-axis indicates the front direction when facing the screen SC, and the positive direction of the Z-axis indicates the upward direction.

[0011] The system of this embodiment includes a first projector 100A, a second projector 100B, and a control device 300. The control device 300, the first projector 100A, and the second projector 100B are daisy-chain connected by wires. The control device 300 is connected to the first projector 100A by wire, and outputs an image signal to the first projector 100A. The first projector 100A is connected to the control device 300 and the second projector 100B by wire, and outputs an image signal input from the control device 300 to the second projector 100B as PL. The control device 300 is, for example, a personal computer, a tablet terminal, or the like.

[0012] In this embodiment, an example in which the control device 300, the first projector 100A, and the second projector 100B are connected by wire will be described, but the control device 300, the first projector 100A, and the second projector 100B may be connected wirelessly. Also, the first projector 100A and the second projector 100B may each be connected to the control device 300 by wire.

[0013] The first projector 100A operates as a primary device, and the second projector 100B operates as a secondary device. During initial setting described below, the first projector 100A operating as the primary device outputs instructions to the second projector 100B, which is the secondary device, to control the operation of the second projector 100B.

[0014] The first projector 100A includes a projector body 10A, an optical system unit 400A, and a first camera 200A. The projector body 10A is installed suspended from the ceiling. The optical system unit 400A is attached to a mounting portion 105A of the projector body 10A so as to be able to project image light PLA onto the screen SC. The first camera 200A is communicably connected to the projector body 10A, and is installed on a mounting portion 911A of the optical system unit 400A so as to be able to capture the first projection image PA displayed on the screen SC. The first camera 200A corresponds to an imaging device.

[0015] The second projector 100B includes a projector body 10B, an optical system unit 400B, and a second camera 200B. The projector body 10B is installed suspended from the ceiling. The optical system unit 400B is attached to a mounting portion 105B of the projector body 10B so as to be able to project the image light PLB onto the screen SC. The second camera 200B is connected to the projector body 10B so as to be able to communicate with the projector body 10B, and is installed on a mounting portion 911B of the optical system unit 400B so as to be able to capture the second projection image PB displayed on the screen SC.

[0016] The projector body 10A extracts image data contained in an image signal input from the control device 300, and generates image light PLA corresponding to the extracted image data. The optical system unit 400A projects the image light PLA generated by the projector body 10A onto the screen SC. The first camera 200A captures an image of an area of ​​the screen SC including the first projection image PA displayed on the screen SC, and generates a captured image. The generated captured image is used for color adjustment of the first projection image PA.

[0017] The projector body 10B extracts image data contained in the image signal input from the first projector 100A, and generates image light PLB corresponding to the extracted image data. The optical system unit 400B projects the image light PLB generated by the projector body 10B onto the screen SC. The first camera 200A captures an image of the area of ​​the screen SC including the first projection image PA displayed on the screen SC, and generates a captured image. The generated captured image is used for color adjustment of the second projection image PB.

[0018] 1 shows that a first projector 100A and a second projector 100B are installed by being suspended from the ceiling on the user side with respect to a rectangular screen SC installed on a vertical wall. A viewer who is a user views an image displayed on the screen SC located below the first projector 100A and the second projector 100B.

[0019] 1, the first projected image PA and the second projected image PB are displayed side by side in the left-right direction of the screen SC, and one large horizontally long image is tiled. When the first projected image PA and the second projected image PB are tiled, the first projector 100A and the second projector 100B project the image light PLA and the image light PLB so that an overlapping area DPA is generated where the first projected image PA and the second projected image PB overlap.

[0020] As shown in FIG. 1, the first projected image PA is composed of a first non-overlapping image PA1 corresponding to the first non-overlapping area NDP1 and a first superimposed image PA2 corresponding to the superimposed area DPA. The first non-overlapping area NDP1 indicates the area other than the superimposed area DPA among the areas corresponding to the first projected image PA. The second projected image PB is composed of a second non-overlapping image PB1 corresponding to the second non-overlapping area NDP2 and a second superimposed image PB2 corresponding to the superimposed area DPA. The second non-overlapping area NDP2 indicates the area other than the superimposed area DPA among the areas corresponding to the second projected image PB. The luminance of the first superimposed image PA2 is adjusted to be lower than the luminance of the first non-superimposed image PA1, and the luminance of the second superimposed image PB2 is adjusted to be lower than the luminance of the second non-superimposed image PB1. Such a process of adjusting the luminance in the superimposed area DPA is called an edge blending process.

[0021] In order to display the first projected image PA and the second projected image PB side by side in the left-right direction of the screen SC and tile a single large horizontally elongated image, the control device 300 supplies image data that is the basis of the single large horizontally elongated image to the first projector 100A. When the first projector 100A extracts image data from the image signal supplied from the control device 300, the first projector 100A cuts out image data that corresponds to the range of the image to be projected by the first projector 100A in accordance with the range information. The image data of the cut-out range is referred to as first partial image data. The second projector 100B extracts image data from the image signal supplied from the first projector 100A, and cuts out image data that corresponds to the range of the image to be projected by the second projector 100B according to the range information. The image data of the cut-out range is called second partial image data.

[0022] The range information includes information in the image data indicating the range onto which the first projector 100A projects an image, and information in the image data indicating the range onto which the second projector 100B projects an image. The range information is generated, for example, by an operator operating the control device 300. The generated range information is output from the control device 300 to the first projector 100A before starting image projection. The first projector 100A outputs the range information input from the control device 300 to the second projector 100B.

[0023] The first projector 100A and the second projector 100B have substantially the same configuration. In the following description, when there is no distinction between the first projector 100A and the second projector 100B, they are referred to as projectors 100. When there is no distinction between the projector body 10A and the projector body 10B, they are referred to as projector body 10. When there is no distinction between the first camera 200A and the second camera 200B, they are referred to as cameras 200. When there is no distinction between the optical system unit 400A and the optical system unit 400B, they are referred to as optical system unit 400. When there is no distinction between the image light PLA and the image light PLB, they are referred to as image light PL.

[0024] [2. Projector configuration] FIG. 2 is a diagram showing an example of the configuration of the first projector 100A. The following describes the configuration of the first projector 100 A. The configuration of the second projector 100 B is substantially the same as the configuration of the first projector 100 B, so a description of the configuration of the first projector 100 B will be omitted. The first projector 100A includes a projector body 10A, an optical system unit 400A, and a first camera 200A.

[0025] The projector main body 10A includes a projection unit 110A, a drive unit 120A, an image interface 131A, an input interface 133A, a remote control light receiving unit 135A, an image processing unit 140A, a frame memory 145A, and a control unit 150A. Hereinafter, the interface is abbreviated as I / F. The image I / F 131A, the input I / F 133A, the image processing unit 140A, and the control unit 150A are connected to each other via a bus 103A so as to be able to communicate data with each other.

[0026] The projection section 110A includes a light source 111A and a light modulation device 112A, and forms an optical image to generate image light PL. The drive section 120A includes a light source drive section 121A and a light modulation device drive section 122A.

[0027] The light source 111A includes a lamp such as a halogen lamp, a xenon lamp, or an extra-high pressure mercury lamp, or a solid-state light source such as an LED (Light Emitting Diode) or a laser light source. The light source driving section 121A turns on and off the light source 111A in accordance with instructions from the control section 150A.

[0028] The light modulation device 112A includes a liquid crystal panel 115A that modulates the light passing therethrough to generate image light PL. The liquid crystal panel 115A includes a liquid crystal panel corresponding to red light, a liquid crystal panel corresponding to green light, and a liquid crystal panel corresponding to blue light. The light emitted by the light source 111A is separated into three color lights of red, green, and blue, which are incident on the corresponding liquid crystal panels 115A. The image light PL modulated after passing through each of the liquid crystal panels 115 is combined by a combining optical system such as a cross dichroic prism, and is output to the optical system unit 400A.

[0029] The light modulation device driving unit 122A drives the light modulation device 112A. The light modulation device driving unit 122A receives image data corresponding to the primary colors of red, green, and blue from the image processing unit 140A, and converts the input image data into a data signal suitable for the operation of the liquid crystal panel 115A. The light modulation device driving unit 122A applies a voltage to each pixel of the liquid crystal panel 115A based on the converted data signal, and draws an image on the liquid crystal panel 115A.

[0030] The optical system unit 400A is mounted on the mounting portion 105A of the projector body 10A, and includes lenses, mirrors, etc. (not shown) that form an image of the image light PL generated by the projection unit 110A on the screen SC. A first camera 200A is attached to the optical system unit 400A so that an area including the projected image P displayed on the screen SC becomes an imaging range. The optical system unit 400A may include a zoom mechanism that enlarges or reduces the image projected on the screen SC, a focus adjustment mechanism that adjusts the focus, etc. The projection unit 110A and the optical system unit 400A correspond to an optical device.

[0031] The first camera 200A includes an imaging section 210A and is attached to the mounting section 911A of the optical system unit 400A. The imaging section 210A includes a lens and an imaging element. The lens focuses incident light from an imaging range on the imaging element. The imaging element is configured with a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) and generates image data. The first camera 200A captures the first projected image PA displayed on the screen SC by the imaging section 210A under the control of the projector body 10A, and outputs the captured image data to the image I / F 131A of the projector body 10A.

[0032] The image I / F 131A includes a connector and an interface circuit, and is connected by wire to the control device 300 that supplies image data to the first projector 100A, and to the first camera 200A that supplies a captured image. The image I / F 131 is, for example, a Universal Serial Bus (USB).

[0033] The input I / F 133A includes an interface circuit and is connected to the remote control light receiving unit 135A. The input I / F 133A is, for example, a High-Definition Multimedia Interface (HDMI). HDMI is a registered trademark. The remote control light receiving section 135A receives an infrared signal transmitted by the remote control 250. The input I / F 133A decodes the signal received by the remote control light receiving section 135A, generates an operation signal, and outputs the operation signal to the control section 150A.

[0034] The frame memory 145A is a storage device that includes a plurality of banks, each of which has a storage capacity capable of writing one frame's worth of image data.

[0035] Image processing unit 140A develops image data input from control device 300 in frame memory 145A. Image I / F 131A extracts image data from an image signal input from an external device, and outputs the extracted image data to image processing unit 140A. The image processing unit 140A performs image processing such as resolution conversion, resizing, distortion correction, shape correction, digital zooming, and adjustment of image color and brightness on the image data expanded in the frame memory 145A.

[0036] The image processing unit 140A and the frame memory 145A are configured, for example, by an integrated circuit. The integrated circuit includes a large scale integrated circuit (LSI), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a system on a chip (SoC), etc. An analog circuit may be included as part of the configuration of the integrated circuit, or the control unit 150A may be configured in combination with the integrated circuit.

[0037] The control unit 150A includes a storage unit 160A and a processor 170A.

[0038] The storage unit 160A includes a volatile storage device and a non-volatile storage device. The volatile storage device is, for example, a random access memory (RAM), etc. The non-volatile storage device is, for example, a read only memory (ROM), a flash memory, an electrically erasable programmable read-only memory (EEPROM), etc. The volatile storage device is used as a calculation area for the processor 170A. The non-volatile storage device stores the control program executed by the processor 170A, and the first, second, third and fourth correction values ​​generated by the automatic color adjustment process and the manual color adjustment process described below.

[0039] The processor 170A is an arithmetic processing device including a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The processor 170A may be configured with a single processor, or may be configured with multiple processors. The processor 170A may be configured with an SoC integrated with a part or all of the storage unit 160A or other circuits. The processor 170A may be configured with a combination of a CPU that executes a program and a DSP (Digital Signal Processor) that executes a predetermined arithmetic processing. Furthermore, the processor 170A may be configured with all of its functions implemented in hardware, or may be configured using a programmable device.

[0040] When the first projector 100A is powered on, the first projector 100A executes an initial adjustment process. In the initial adjustment process, each projection condition is adjusted so that the image displayed on the screen SC is in a state desired by the viewer. The initial adjustment process includes a color adjustment process that matches the color of the projection image projected by the first projector 100A with the color of the projection image projected by the second projector 100B, and the above-mentioned edge blending process.

[0041] The color adjustment process includes an automatic color adjustment process and a manual color adjustment process. The automatic color adjustment process is executed when the first projector 100A has never executed the automatic color adjustment process, or when the correction data generated by the automatic color adjustment process is not stored in the storage unit 160A. The automatic color adjustment process is executed when a preset condition is satisfied. In this embodiment, when a preset period has elapsed since the first correction value and the third correction value were generated, the first projector 100A reexecutes the automatic color adjustment process. For example, the automatic color adjustment process may be reexecuted when the accumulated operation time since the first correction value and the third correction value were generated reaches a preset time. In this embodiment, a case will be described in which the first projector 100A, which is a primary device, executes the automatic color adjustment process, but the second projector 100B, which is a secondary device, or the control device 300 may execute the automatic color adjustment process.

[0042] In the automatic color adjustment process, correction data is generated to correct the color of the projection images projected onto the screen SC by the first projector 100A and the second projector 100B. The correction data to correct the color of the first projection image PA projected by the first projector 100A is referred to as first correction data, and the correction data to correct the color of the second projection image PB projected by the second projector 100B is referred to as third correction data.

[0043] In the automatic color adjustment process, a screen SC on which a test pattern is projected by the first projector 100A is captured by the first camera 200A of the first projector 100A to generate a first captured image. The test pattern includes, for example, a pattern of brightness with multiple gradations for each of the colors RGB, i.e., red, green, and blue. Similarly, the screen SC on which the test pattern is projected by the second projector 100B is captured by the first camera 200A of the first projector 100A to generate a second captured image. The first projector 100A compares the first captured image with the second captured image to generate first correction data and third correction data.

[0044] Next, the manual color adjustment process will be described. The manual color adjustment process is a process for correcting the color of the projection image P projected onto the screen SC by the first projector 100A and the second projector 100B by manual operation of an operator. The manual color adjustment process is executed by both or either of the first projector 100A and the second projector 100B.

[0045] FIG. 3 is a diagram showing an example of an operation screen 50 that the first projector 100A displays on the screen SC during the manual color adjustment process. The manual color adjustment process executed by the first projector 100A will be described below. First, the control unit 150A causes the operation screen 50 to be displayed on the screen SC. Here, the operation screen 50 will be described with reference to Fig. 3. The operation screen 50 displayed in the manual color adjustment process executed by the first projector 100A corresponds to a user interface that accepts a first operation. The operation screen 50 displayed in the manual color adjustment process executed by the second projector 100B corresponds to a user interface that accepts a second operation.

[0046] The operation screen 50 includes a gradation value display field 51, a red display field 52, a green display field 53, and a blue display field 54. The gradation value selected by the operator is displayed in the gradation value display field 51. The operation screen 50 also displays a first operator 55 and a second operator 56. In the operation screen 50 shown in FIG. 3, the gradation value display field 51 is in a selected state, so the first operator 55 and the second operator 56 are displayed in the gradation value display field 51. The first operator 55 is an operator that accepts an operation to decrease the gradation value displayed in the gradation value display field 51. The second operator 56 is an operator that accepts an operation to increase the gradation value displayed in the gradation value display field 51.

[0047] The red display field 52 displays the red gradation value. The green display field 53 displays the green gradation value. The blue display field 54 displays the blue gradation value. When the red display column 52 is selected by the operator, the first operator 55 and the second operator 56 are displayed in the red display column 52. Similarly, when the green display column 53 is selected, the first operator 55 and the second operator 56 are displayed in the green display column 53, and when the blue display column 54 is selected, the first operator 55 and the second operator 56 are displayed in the blue display column 54.

[0048] For example, when the first operator 55 is operated while the red display column 52 is selected, the gradation value of red is decreased. Also, when the second operator 56 is operated while the red display column 52 is selected, the gradation value of red is increased. Similarly, when the first operator 55 is operated while the green display column 53 is selected, the gradation value of green is decreased. Moreover, when the second operator 56 is operated while the green display column 53 is selected, the gradation value of green is increased. Similarly, when the blue display column 54 is selected and the first operator 55 is operated, the gradation value of blue is decreased. Moreover, when the blue display column 54 is selected and the second operator 56 is operated, the gradation value of blue is increased.

[0049] In the manual color adjustment process, the first projector 100A projects a test pattern having, for example, red, green, and blue patterns onto the screen SC. Here, the projected test pattern is an image based on image data corrected by the first correction value, and is a pattern having a gradation value selected by the operator. The test pattern corresponds to the third image. This test pattern is a so-called solid pattern in which the color and brightness of the image do not change. For example, in the manual adjustment process, eight gradation values ​​can be selected as the gradation value of the test pattern. The gradation value selected by the operator by operating the remote control 250 is called the selected gradation value.

[0050] The operator visually checks the test pattern displayed on the screen SC, and selects at least one of red, green, and blue by operating the remote control 250. The color selected by the operator is called the selected color. The operator also operates the remote control 250 to set an increment or decrement for increasing or decreasing the gradation value of the selected color. The first projector 100A generates a test pattern in which the gradation value of the selected color is changed by the set increment or decrement, and displays the generated test pattern again on the screen SC.

[0051] When the confirm button of the remote control 250 is pressed, the first projector 100A stores the selected gradation value and the amount of increase or decrease in the gradation value for each of the colors red, green, and blue in association with each other in the storage unit 160A. The selected gradation value and the amount of increase or decrease in the gradation value for each of the colors red, green, and blue correspond to the second correction value. When executing the manual color adjustment process, the second projector 100B executes the manual color adjustment process to generate a fourth correction value, similar to the first projector 100A. The test pattern projected by the second projector 100B on the screen SC by the manual color adjustment process corresponds to the fourth image. In the manual color adjustment process of the first projector 100A, receiving an operation to change the gradation value corresponds to receiving a first operation. In the manual color adjustment process of the second projector 100B, receiving an operation to change the gradation value corresponds to receiving a second operation.

[0052] Next, the reason for executing the manual color adjustment process after executing the automatic color adjustment process will be described. Conventionally, it has been difficult to accurately correct color shifts caused by systematic errors in automatic color adjustment processing that adjusts the colors of the first projected image PA and the second projected image PB using an image captured by the camera 200. Systematic errors are errors that occur due to variations in the spectral sensitivity of the color filter of the camera 200 or variations in the spectrum of the light source 111 of the projector 100. Due to this systematic error, when the first captured image of the first projected image PA is compared with the second captured image of the second projected image PB, even if the images are judged to have the same color, the human eye will recognize a slight color difference. This color error will not improve no matter how many times the automatic color adjustment process is repeated. For this reason, in this embodiment, after the automatic color adjustment process is performed, a manual color adjustment process is performed using the human eye.

[0053] Moreover, the first and third correction values ​​generated by the automatic color adjustment process are erased from the storage unit 160 every time a preset period has elapsed. Then, new first and third correction values ​​are stored in the storage unit 160 by executing the automatic color adjustment process again. Once the second and fourth correction values ​​are generated by the manual color adjustment process, they are stored in the storage unit 160 and are not deleted. That is, even if the first and third correction values ​​are updated by the automatic color adjustment process, the same values ​​are used for the second and fourth correction values.

[0054] When the first and third correction values ​​updated by the automatic color adjustment process are significantly different, it appears that color errors will occur between the first and second projected images PA and PB even if the image data is corrected using the second and fourth correction values ​​generated by the manual color adjustment process. However, because the error caused by the automatic color adjustment process is an error resulting from a systematic error, the first and third correction values ​​generated by the automatic color adjustment process do not change significantly. Therefore, even if the image data is corrected using the second and fourth correction values ​​generated during the initial setting, the image data can be corrected with high precision, and the first projected image PA and the second projected image PB can be color-matched with high precision.

[0055] [3. Operation of the first projector] 4 is a flowchart showing the operation of the first projector 100A which is the primary device. The operation of the first projector 100A will be described with reference to the flowchart shown in FIG. When the first projector 100A is powered on (step S1 / YES), the control unit 150A determines whether or not a correction value for color adjustment has been generated by the automatic color adjustment process (step S2). That is, the control unit 150A determines whether or not the correction value generated by executing the automatic color adjustment process has been stored in the storage unit 160A.

[0056] If the correction value has not been generated (step S2 / NO), the control unit 150A executes an automatic color adjustment process (step S3) to generate a correction value for color adjustment. Details of the automatic color adjustment process will be described with reference to the flowchart shown in FIG. 5. Step S3 corresponds to executing a first process. The control unit 150A executes the automatic color adjustment process to generate a first correction value for correcting the first partial image data projected by the first projector 100A and a third correction value for correcting the second partial image data projected by the second projector 100B. The control unit 150A stores the generated first correction value in the storage unit 160A (step S4) and outputs the generated third correction value to the second projector 100B (step S5).

[0057] Next, the control unit 150A judges whether or not the start of the manual color adjustment process has been instructed (step S6). Specifically, the control unit 150A judges whether or not an operation signal instructing the start of the manual color adjustment process has been input from the remote control light receiving unit 250A via the input I / F 133A. If the start of the manual color adjustment process has not been instructed (step S6 / NO), the control unit 150A ends this processing flow.

[0058] When the control unit 150A is instructed to start the manual color adjustment process (step S6 / YES), it executes the manual color adjustment process (step S7) and stores the second correction value generated by the manual color adjustment process in the storage unit 160A (step S8). Step S7 corresponds to executing the second process. After executing the manual color adjustment process and storing the second correction value in the storage unit 160A, the control unit 150A operates according to the flowchart shown in FIG. 7. That is, the control unit 150A waits until an image signal is input from the control device 300.

[0059] Next, the operation when the correction value has already been generated will be described. If the control unit 150A has already generated the first correction value and the second correction value (step S2 / YES), it determines whether a preset period has elapsed since the automatic color adjustment process was last performed to generate the first correction value (step S9).

[0060] If the preset period has not elapsed (step S9 / NO), the control unit 150A ends this process flow. Furthermore, when a preset period has elapsed (step S9 / YES), the control unit 150A erases the first correction value stored in the storage unit 160A from the storage unit 160A (step S10). Furthermore, the control unit 150A instructs the second projector 100B to erase the third correction value (step S11).

[0061] Next, the control unit 150A executes an automatic color adjustment process (step S12) to generate a correction value for color adjustment. Details of the automatic color adjustment process will be described with reference to the flowchart shown in Fig. 5. Step S12 corresponds to re-executing the first process and updating the first correction value when a preset setting condition is met. The control unit 150A executes an automatic color adjustment process to generate a first correction value for correcting the first partial image data projected by the first projector 100A and a third correction value for correcting the second partial image data projected by the second projector 100B. The control unit 150A stores the generated first correction value in the storage unit 160A (step S13) and outputs the generated third correction value to the second projector 100B (step S14). After executing a manual color adjustment process to store the second correction value in the storage unit 160A, the control unit 150A operates according to the flowchart shown in FIG. 7. That is, the control unit 150A waits until an image signal is input from the control device 300. Steps S13 and S14 correspond to outputting the first correction value and the second correction value.

[0062] FIG. 5 is a flowchart showing the processing operations of the automatic color adjustment process. The automatic color adjustment process will be described in detail with reference to the flowchart shown in FIG. First, the control unit 150A causes the projection unit 110A to generate image light PLA corresponding to the test pattern, and causes the optical system unit 400A to project the generated image light PLA onto the screen SC. As a result, a first projection image PA corresponding to the test pattern is displayed on the screen SC (step S21). The first projection image PA corresponding to the test pattern projected here includes, for example, a luminance pattern with multiple gradations for each of red, green, and blue. The test pattern TP is, for example, a pattern in which the color and luminance of the image do not change depending on the projection position, a so-called solid pattern. The first projection image PA corresponding to the test pattern displayed in step S21 corresponds to the first image.

[0063] Next, the control unit 150A causes the first camera 200A to capture the screen SC on which the first projected image PA is displayed (step S22). The control unit 150A causes the captured image generated by the first camera 200A to be stored in the storage unit 160A as a first captured image (step S23). The first captured image stored in the storage unit 160A corresponds to the imaging result.

[0064] Next, the control unit 150A instructs the second projector 100B to project a test pattern (step S24). The test pattern projected by the second projector 100B corresponds to the second image.

[0065] Next, the control unit 150A determines whether or not there is a notification from the second projector 100B that the test pattern has been projected (step S25). This notification is a notification indicating that the test pattern has been projected. If there is no notification from the second projector 100B (step S25 / NO), the control unit 150A waits until there is a notification from the second projector 100B.

[0066] When the control unit 150A is notified by the second projector 100B that the test pattern has been projected (step S25 / YES), the control unit 150A causes the first camera 200A to capture an image of the screen SC on which the first projected image PA is displayed (step S26). Next, the control unit 150A causes the second captured image input from the first camera 200A to be stored in the storage unit 160A (step S27). The second captured image stored in the storage unit 160A corresponds to the imaging result.

[0067] Next, the control unit 150A generates a first correction value and a third correction value based on the first captured image and the second captured image (step S28). The control unit 150A compares the first captured image and the second captured image. The control unit 150A compares the red, green, and blue colors included in the test pattern captured in the first captured image and the second captured image for each gradation to generate a first correction value and a third correction value.

[0068] FIG. 6 is a flowchart showing the processing operations of the manual color adjustment process. The manual color adjustment process will be described in detail with reference to the flowchart shown in FIG. When the manual color adjustment process is started, the control unit 150A displays the operation screen 50 at a position on the screen SC (step S31). The operation screen 50 is displayed in a corner of the screen SC so as not to interfere with the display of a test pattern to be displayed on the screen SC.

[0069] Next, the control unit 150A judges whether or not an operation signal for selecting a gradation value of a test pattern has been input from the remote control light receiving unit 250A via the input I / F 133A (step S32). The gradation value of the test pattern for performing the manual color adjustment process is set in advance. In this embodiment, 8 gradations out of 0 to 255 gradations are set as the gradation values ​​for performing the manual color adjustment process. The operator operates the remote control 250 to select the gradation value of the pattern to be displayed as the test pattern from the set gradation values. If the operation signal for selecting a gradation value has not been input (step S32 / NO), the control unit 150A waits until an operation signal for selecting a gradation value is input.

[0070] When an operation signal for selecting a gradation value is input (step S32 / YES), the control unit 150A generates a test pattern of the gradation value selected by the operation signal (step S33). The test pattern generated here is a pattern image generated based on image data corrected by the first correction value generated by the automatic color adjustment process of step S3 shown in FIG.

[0071] The control unit 150A causes the projection unit 110A to generate image light PLA corresponding to the test pattern, and causes the optical system unit 400A to project the generated image light PLA onto the screen SC. As a result, a first projection image PA corresponding to the test pattern is displayed on the screen SC (step S34). The test pattern displayed here is different from the test pattern described in FIG. 5, and includes, for example, a selected luminance pattern of one gradation for each of red, green, and blue.

[0072] Next, the control unit 150A judges whether or not an operation to select at least one of red, green, and blue and an operation to change the gradation value of the selected color have been received (step S35). If the control unit 150A has not received an operation to select at least one color and an operation to change the gradation value of the selected color (step S35 / NO), the control unit 150A proceeds to the judgment of step S38.

[0073] Furthermore, when control unit 150A receives an operation to change the gradation value for at least one of red, green, and blue (step S35 / YES), it changes the gradation value of the test pattern to be projected onto screen SC. Specifically, control unit 150A generates a test pattern in which the gradation value of the color selected by the received operation is changed to the selected gradation value (step S36). Control unit 150A causes projection unit 110A to display the generated test pattern on screen SC (step S37).

[0074] Next, the control unit 150A judges whether or not the Confirm button of the remote control 250 is pressed and an operation signal corresponding to the Confirm button is input from the remote control light receiving unit 250A via the input I / F 133A (step S38). If an operation signal corresponding to the Confirm button is not input (step S38 / NO), the control unit 150A returns to the judgment of step S35.

[0075] Furthermore, when an operation signal corresponding to the confirm button is input (step S38 / YES), the control unit 150A generates a test pattern with the eight set gradation values ​​and judges whether or not the generated test pattern has been displayed on the screen SC (step S39). If the control unit 150A generates a test pattern with the eight set gradation values ​​and has not displayed the generated test pattern on the screen SC (step S39 / NO), the control unit 150A returns to the process of step S33.

[0076] Furthermore, when the control unit 150A determines that a test pattern has been generated using eight gradation values ​​and that the generated test pattern has been displayed on the screen SC (step S39 / YES), it generates a second correction value (step S40). The control unit 150A generates the second correction value by storing in the storage unit 160A the increase or decrease amounts for each of the colors red, green, and blue for the eight gradation values ​​displayed as the test pattern. Then, the control unit 150A proceeds to the next step S8.

[0077] FIG. 6 shows the process flow of the manual color adjustment process executed by the first projector 100A, but the second projector 100B may also execute the manual color adjustment process according to the process flow shown in FIG. 6 to generate the fourth correction value.

[0078] 7 is a flowchart showing the operation of the first projector 100A when projecting an image. The operation of the first projector 100A when an image signal is input will be described with reference to the flowchart shown in FIG. First, the control unit 150A determines whether or not an image signal supplied from the control device 300 has been input (step S41). If an image signal has not been input (step S41 / NO), the control unit 150A waits until an image signal is input.

[0079] When an image signal is input (step S41 / YES), the control unit 150A outputs the input image signal to the subsequent second projector 100B (step S42).

[0080] Next, the control unit 150A extracts the image data included in the image signal, and cuts out the range of the image data to be projected by the first projector 100A. The control unit 150A cuts out the range of the image data corresponding to the range information set by the initial setting, and generates first partial image data (step S43). The control unit 150A corrects the first partial image data using the first correction value (step S44).

[0081] Next, the control unit 150A determines whether the third correction value is stored in the storage unit 160A (step S45). If the third correction value is not stored in the storage unit 160A (step S45 / NO), the control unit 150A causes the projection unit 110A to generate image light PLA based on the first partial image data corrected by the first correction value. The control unit 150A causes the optical system unit 113A to project the generated image light PLA based on the first partial image data, and causes an image based on the first partial image data to be displayed on the screen SC (step S47).

[0082] Furthermore, when the third correction value is stored in the storage unit 160A (step S45 / YES), the control unit 150A further corrects the first partial image data corrected using the first correction value based on the third correction value (step S46).

[0083] Next, the control unit 150A causes the projection unit 110A to generate image light PLA based on the first partial image data corrected by the first correction value and the third correction value. The control unit 150A causes the optical system unit 113A to project the generated image light PLA based on the first partial image data, and causes an image based on the first partial image data to be displayed on the screen SC (step S47).

[0084] Next, the control unit 150A determines whether the input of the image signal from the control device 300 has ended (step S48). If the input of the image signal has not ended (step S48 / NO), the control unit 150A returns to the process of step S42. If the input of the image signal has ended (step S48 / YES), the control unit 150A ends this process flow.

[0085] Although Fig. 7 shows the operation of the first projector 100A during image projection, the second projector 100B may also perform image projection according to the processing flow shown in Fig. 7. The second projector 100B uses the third correction value and the fourth correction value.

[0086] In the description of the above-mentioned flowchart, in the automatic color adjustment process, first, the first projector 100A displays a first projected image PA corresponding to a test pattern on the screen SC, and the first camera 200A captures the screen SC to generate a first captured image. After that, the second projector 100B displays a second projected image PB corresponding to the test pattern on the screen SC, and the first camera 200A captures the screen SC to generate a second captured image. As another operation, a first projected image PA and a second projected image PB corresponding to a test pattern may be displayed on a screen SC, and the screen SC on which the first projected image PA and the second projected image PB are displayed may be captured to generate a captured image.

[0087] [4. Other embodiments] The above-described embodiment is a preferred embodiment, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit and scope of the present invention. For example, in the flowchart shown in Fig. 4 described above, a case has been described in which it is determined in step S9 whether or not a set period has elapsed as a preset setting condition for re-executing the automatic color adjustment process. As another example of the setting condition, it may be determined that the setting condition is met when a signal instructing re-execution is received from an external device such as the control device 300. Also, the first projector 100A may be connected to a network (not shown), and the automatic color adjustment process may be re-executed when a signal instructing re-execution is received from a server device connected to this network. Also, for example, the automatic color adjustment process may be executed again every time the first projector 100A or the second projector 100B is turned on.

[0088] In the above-described embodiment, the operation of the first projector 100A, which is the primary device, generating the first correction value, the second correction value, and the third correction value has been described. However, the device that generates the correction values ​​is not limited to the projector 100. For example, the control device 300 may acquire the first captured image and the second captured image from the first projector 100A and generate the first correction value and the third correction value. Moreover, the control device 300 may display the operation screen 50 on a display panel provided in the control device 300, and the control device 300 may instruct the first projector 100A on the gradation value of the first projected image PA to be displayed as a test pattern. Similarly, the control device 300 may instruct the second projector 100B on the gradation value of the second projected image PB to be displayed as a test pattern. The control device 300 generates the second correction value and the fourth correction value based on the operation of the operation screen 50. The control device 300 outputs the generated first correction value and the second correction value to the first projector 100A, and outputs the generated third correction value and the fourth correction value to the second projector 100B.

[0089] In the above embodiment, the manual color adjustment process is executed after the automatic color adjustment process, but if the operator determines that the manual color adjustment process is not necessary after the automatic color adjustment process is executed, the manual color adjustment process may be omitted. In this case, the control unit 150A stores a flag in the storage unit 160 indicating that the manual color adjustment process has been omitted. When a flag indicating that the manual color adjustment process has been omitted is stored in the memory unit 160, the control unit 150A performs the process of step S44 shown in FIG. 7, and then proceeds to the operation of step S47 without making the judgment of step S45.

[0090] In the embodiment described above, the mounting portion 911 of the camera 200 is disposed on the optical system unit 400, but the embodiment of the present invention is not limited to this. It is sufficient that the mounting portion 911 of the camera 200 is disposed on the projector 100.

[0091] In this embodiment, the light modulation device 112 includes a transmissive liquid crystal panel 115 as a light modulation element, but the embodiment of the present invention is not limited to this. The light modulation element may be a reflective liquid crystal panel or a digital micromirror device.

[0092] 2 indicates a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Also, some of the functions realized by software in the above embodiment may be realized by hardware, or some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of each of the other units of the projector 100 and the camera 200 can also be arbitrarily changed within the scope of the gist.

[0093] Furthermore, when the color adjustment method and the program are realized using a computer included in the projector 100, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specific examples include portable or fixed recording media such as a flexible disk, HDD (Hard Disk Drive), CD-ROM, DVD, Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording medium. The recording medium may also be a non-volatile storage device such as RAM, ROM, or HDD, which is an internal storage device included in the server device. Blu-ray is a registered trademark.

[0094] 5. Summary of this Disclosure The following is a summary of this disclosure. (Appendix 1) a first process for determining a first correction value to be used when correcting a color of a first image projected by a first projector and a second image projected by a second projector based on an imaging result of the first image and a second image projected by a second projector; a second process for determining a first correction value to be used when correcting a color of a third image obtained by correcting the first image using the first correction value, the third image being obtained by correcting the first image using the first correction value, the second process including: receiving a first operation for correcting the color of the third image projected by the first projector; and determining a second correction value to be used when correcting the color of the third image based on a result of the first operation; updating the first correction value by re-executing the first process when a preset setting condition is met; and outputting the first correction value and the second correction value updated by re-executing the first process.

[0095] According to this, it is possible to correct the color of the first image projected by the first projector using the first correction value that is corrected when a preset setting condition is satisfied and the second correction value that is determined based on the result of an operation performed by an operator. Therefore, it is not necessary to perform manual color adjustment every time a process for matching the colors of the first image projected by the first projector and the second image projected by the second projector is executed.

[0096] (Appendix 2) The color adjustment method described in Appendix 1, wherein the first process includes determining a third correction value to be used when correcting a color of the second image, and the second process includes accepting a second operation to correct a color of the fourth image projected by the second projector, the fourth image being a fourth image obtained by correcting the second image using the third correction value, and determining a fourth correction value to be used when correcting the color of the fourth image based on a result of the second operation.

[0097] According to this, the operator can determine the fourth correction value for correcting the color of the second image projected by the second projector by performing an operation while visually checking the second image. Therefore, it is possible to determine the fourth correction value for correcting the color of the second image by reflecting the visual checking result of the second image.

[0098] (Appendix 3) The color adjustment method according to claim 1 or 2, wherein the step of updating the first correction value determines that the setting condition is met when a preset setting period has elapsed.

[0099] According to this, the first process is executed and the first correction value is updated every time a preset period has elapsed. Therefore, the first correction value can be updated every time the preset period has elapsed to a first correction value that corresponds to the installation conditions of the first projector.

[0100] (Appendix 4) 3. The color adjustment method according to claim 1, wherein updating the first correction value determines that the setting condition is satisfied when an instruction to re-execute the first process is accepted.

[0101] According to this, when a re-execution instruction is input from outside, the first process is re-executed and the first correction value is updated. Therefore, it is possible to re-execute the first process in response to an external instruction and update the first correction value.

[0102] (Appendix 5) The color adjustment method described in Appendix 1 or 2, wherein executing the second process includes displaying a user interface that accepts the first operation, and accepting the first operation includes accepting the first operation via the user interface.

[0103] This makes it possible to determine the second correction value based on the operation performed by the operator on the user interface.

[0104] (Appendix 6) The color adjustment method of claim 2, wherein executing the second process includes displaying a user interface that accepts the second operation, and accepting the second operation includes accepting the second operation via the user interface.

[0105] This makes it possible to determine the fourth correction value based on the operation performed by the operator on the user interface.

[0106] (Appendix 7) The color adjustment method of any one of Appendix 1 to 6, wherein executing the first process includes determining the first correction value based on a first captured image obtained by capturing an image of a projection surface on which the first image is projected by the first projector and the second image is not projected by the second projector, and a second captured image obtained by capturing an image of the projection surface on which the first image is not projected by the first projector and the second image is projected by the second projector.

[0107] According to this, the first correction value is determined based on a captured image obtained by capturing a projection surface on which the first image is projected and the second image is not projected, and a captured image obtained by capturing a projection surface on which the first image is not projected and the second image is projected, so that the first correction value can be determined with high accuracy based on the captured images.

[0108] (Appendix 8) a first process for determining a first correction value to be used when correcting a color of a first image projected by the optical device and a second image projected by another projector, based on an imaging result of the first image projected by the optical device and a second image projected by another projector; a first operation for correcting a color of the third image projected by the optical device, the third image being a third image obtained by correcting the first image using the first correction value; a second process for determining a second correction value to be used when correcting the color of the third image, based on a result of the first operation; updating the first correction value by re-executing the first process when a preset setting condition is met; and outputting the first correction value and the second correction value updated by re-executing the first process.

[0109] According to this, it is possible to correct the color of the first image projected by the first projector using the first correction value that is corrected when a preset setting condition is satisfied and the second correction value that is determined based on the result of an operation performed by an operator. Therefore, it is not necessary to perform manual color adjustment every time a process for matching the colors of the first image projected by the first projector and the second image projected by the second projector is executed.

[0110] (Appendix 9) A program that causes a computer to execute the following steps: execute a first process to determine a first correction value to be used when correcting a color of a first image projected by a first projector and a second image projected by a second projector, based on an imaging result of the first image projected by a first projector; accept a first operation to correct the color of the third image projected by the first projector, the third image being a third image obtained by correcting the first image with the first correction value; execute a second process to determine a second correction value to be used when correcting the color of the third image, based on a result of the first operation; update the first correction value by re-executing the first process when a preset setting condition is met; and output the first correction value and the second correction value updated by re-executing the first process.

[0111] According to this, it is possible to correct the color of the first image projected by the first projector using the first correction value that is corrected when a preset setting condition is satisfied and the second correction value that is determined based on the result of an operation performed by an operator. Therefore, it is not necessary to perform manual color adjustment every time a process for matching the colors of the first image projected by the first projector and the second image projected by the second projector is executed. [Explanation of symbols]

[0112] 10, 10A, 10B... projector body, 50... operation screen, 51... gradation value display column, 52... red display column, 53... green display column, 54... blue display column, 55... first operator, 56... second operator, 100... projector, 100A... first projector, 100B... second projector, 103A... bus, 105A, 105B... mounting section, 110A... projection section, 111A... light source, 112, 112A... light modulation device, 113A... optical system unit, 115A... liquid crystal panel, 120A... drive section, 121A... light source drive section, 122A... light modulation device drive section, 131A... image I / F, 133A...input interface, 135A...remote control receiver, 140A...image processing unit, 145A...frame memory, 150A...control unit, 160, 160A...storage unit, 170A...processor, 200...camera, 200A...first camera, 200B...second camera, 210A...imaging unit, 250...remote control, 250A...remote control receiver, 300...control device, 400, 400A, 400B...optical system unit, 911, 911A, 911B...camera mounting unit, P...projected image, PA...first projected image, PB...second projected image, PL, PLA, PLB...image light.

Claims

1. executing a first process for determining a first correction value to be used when correcting a color of a first image projected by a first projector and a second image projected by a second projector, based on an imaging result of the first image projected by a first projector and a second image projected by a second projector; receiving a first operation to correct a color of a third image projected by the first projector, the third image being obtained by correcting the first image using the first correction value; determining a second correction value to be used in correcting the color of the third image based on a result of the first operation; performing a second process including: updating the first correction value by re-executing the first process when a preset condition is met; outputting the first correction value and the second correction value updated by re-executing the first process; Color adjustment methods including:

2. The first process includes: determining a third correction value for use in correcting the color of the second image; The second process includes: receiving a second operation to correct a color of a fourth image projected by the second projector, the fourth image being obtained by correcting the second image using the third correction value; determining a fourth correction value to be used in correcting the color of the fourth image based on a result of the second operation; Including, The color adjustment method according to claim 1.

3. Updating the first correction value includes: When a preset period has elapsed and it is determined that the set condition is met, the process is executed. The color adjustment method according to claim 1 or 2.

4. Updating the first correction value includes: The first process is executed when it is determined that the set condition is satisfied upon receiving an instruction to re-execute the first process. The color adjustment method according to claim 1 or 2.

5. Executing the second process includes: displaying a user interface that accepts the first operation; Receiving the first operation includes: receiving the first operation via the user interface; The color adjustment method according to claim 1 or 2.

6. Executing the second process includes: displaying a user interface that accepts the second operation; Receiving the second operation includes: receiving the second operation via the user interface; The color adjustment method according to claim 2.

7. Executing the first process includes: a first captured image obtained by capturing an image of a projection surface on which the first image is projected by the first projector and on which the second image is not projected by the second projector; and a second captured image obtained by capturing an image of the projection surface on which the first image is not projected by the first projector and the second image is projected by the second projector; and determining the first correction value based on The color adjustment method according to claim 1 .

8. an optical device; An imaging device; at least one processor; The at least one processor Executing a first process to determine a first correction value to be used when correcting a color of a first image projected by the optical device and a second image projected by another projector, based on imaging results of the first image projected by the optical device and a second image projected by another projector; receiving a first operation to correct a color of a third image obtained by correcting the first image using the first correction value and projected by the optical device; performing a second process including determining a second correction value to be used when correcting the color of the third image based on a result of the first operation; updating the first correction value by re-executing the first process when a preset condition is met; outputting the first correction value and the second correction value updated by re-executing the first process; Run the projector.

9. On the computer, executing a first process for determining a first correction value to be used when correcting a color of a first image projected by a first projector and a second image projected by a second projector, based on an imaging result of the first image projected by a first projector and a second image projected by a second projector; receiving a first operation to correct a color of a third image projected by the first projector, the third image being obtained by correcting the first image using the first correction value; performing a second process including determining a second correction value to be used when correcting the color of the third image based on a result of the first operation; updating the first correction value by re-executing the first process when a preset condition is met; outputting the first correction value and the second correction value updated by re-executing the first process; A program that executes the following.

Images