Information processing method, information processing apparatus, and program

Abstract

To reduce a situation where the brightness of projection images from a plurality of projectors is decreased in adjustment of color irregularities and brightness of the projection images.SOLUTION: An information processing method includes: determining the brightness of a first projector included in a first projector group, based on first brightness of a first image group in a first area of a projection surface projected by the first projector group and second brightness of a second image group in a second area of the projection surface projected by a second projector group; and determining at least one of a color correction value used by the first projector and a color correction value used by the second projector based on the color of a first image in the first area projected by the first projector and the color of a second image in the second area projected by a second projector included in the second projector group.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing method, an information processing device, and a program. [Background technology]

[0002] Conventionally, when multiple projectors are used in combination, adjustments are made so that differences in color and brightness between the individual projectors are not noticeable. For example, Patent Document 1 discloses a technology for adjusting brightness and color for multiple projectors that project an image onto one display surface. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-71608 Summary of the Invention [Problem to be solved by the invention]

[0004] In the method described in Patent Document 1, in brightness adjustment, the brightness of multiple projectors that project one composite image is estimated, and the other projectors are darkened to match the darkest projector. In addition, in color adjustment, the color of the image projected by the projectors is estimated, and the color of each projector is adjusted to match the average color value of the multiple projectors that project one composite image. While this method makes it possible to appropriately match the colors of multiple projectors, there is a problem in that the brightness of the image projected on the display surface is reduced because the brightness of the other projectors is reduced to match the darkest projector. [Means for solving the problem]

[0005] One aspect of the present disclosure is an information processing method that includes determining a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group including a plurality of projectors and different from the first projector group, and determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first region by the first projector and a color of a second image projected onto the second region by a second projector included in the second projector group.

[0006] Another aspect of the present disclosure is an information processing device that includes at least one processor, wherein the at least one processor executes the following operations: determining a brightness of a first projector included in the first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group including a plurality of projectors and different from the first projector group; and determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first region by the first projector and a color of a second image projected onto the second region by a second projector included in the second projector group.

[0007] Another aspect of the present disclosure is a program executable by a computer, which causes the computer to determine a brightness of a first projector included in the first projector group based on a first brightness of a first image group projected onto a first area of ​​a projection surface by a first projector group including a plurality of projectors and a second brightness of a second image group projected onto a second area of ​​the projection surface that partially overlaps with the first area by a second projector group including a plurality of projectors and different from the first projector group, and to determine at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first area by the first projector and a color of a second image projected onto the second area by a second projector included in the second projector group. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a display system. [Diagram 2] FIG. 4 is a diagram showing an example of the configuration of a projected image. [Diagram 3] Block diagram of the projector. [Figure 4] FIG. [Diagram 5] 4 is a flowchart showing the operation of the display system. [Figure 6] 4 is a flowchart showing the operation of the display system. [Figure 7] 4 is a flowchart showing the operation of the display system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] [1. Display system overview] Fig. 1 is a diagram showing an example of a projection system 1000. Fig. 2 is a diagram showing an example of the configuration of a projection image P projected by the projection system 1000 onto a projection surface SC.

[0011] The projection system 1000 includes multiple projectors 1 and a control device 2. In this embodiment, an example will be described in which the projection system 1000 includes four projectors 1. In the following description, the four projectors 1 are referred to as a first projector 1A, a second projector 1B, a third projector 1C, and a fourth projector 1D, and will be referred to as the projector 1 when there is no need to distinguish between them. The control device 2 corresponds to an example of an information processing device.

[0012] The projector 1 projects a projection image P onto the projection surface SC. The projection image P is formed by overlapping a plurality of images projected by a plurality of projectors 1 and arranging them side by side. In detail, the first projector 1A projects a first image 3A onto the projection surface SC, and the second projector 1B projects a second image 3B onto the projection surface SC. The third projector 1C projects a third image 3C, and the fourth projector 1D projects a fourth image 3D. The first image 3A, the second image 3B, the third image 3C, and the fourth image 3D form one projection image P on the projection surface SC. In FIG. 1, the first image 3A, the second image 3B, the third image 3C, the fourth image 3D, the first overall image E1, and the second overall image E2 are shifted relative to one another for convenience in order to make them easily distinguishable, but in reality, the first image 3A and the third image 3C, the second image 3B and the fourth image 3D, and the first overall image E1 and the second overall image E2 overlap in a common area on the projection surface SC.

[0013] The projection surface SC is a surface that makes an image visible by the image light projected by the projector 1, and may be a curtain or a hard flat surface. The projection surface SC may be, for example, a screen for a projector, a wall, ceiling, or floor of a building, or other surface, and may be a flat surface or a curved surface. For ease of understanding, in this embodiment, the projection surface SC is illustrated and described as a flat surface.

[0014] 2, in this embodiment, a first area A1 and a second area A2 are arranged on the projection surface SC. The projection areas arranged on the projection surface SC are not limited to the first area A1 and the second area A2, and the projector 1 may project an image onto three or more areas.

[0015] The first image 3A and the third image 3C are projected in a superimposed manner onto the first area A1 of the projection surface SC. The second image 3B and the fourth image 3D are projected in a superimposed manner onto the second area A2 of the projection surface SC. Therefore, the first projector 1A and the third projector 1C perform stack projection onto the projection surface SC, and the second projector 1B and the fourth projector 1D perform stack projection onto the projection surface SC. Here, the first image 3A and the third image 3C are defined as a first image group 41. In other words, the first image group 41 is an image group including a plurality of images projected onto the first area A1, and includes the first image 3A and the third image 3C. Similarly, the second image 3B and the fourth image 3D are defined as a second image group 42.

[0016] In the projection system 1000, multiple projectors 1 that perform stack projection constitute a projector group. Multiple projectors 1 that project images onto the same area of ​​the projection surface SC are considered to be a projector group. In this embodiment, the first projector 1A and the third projector 1C that project images onto the first area A1 are included in the first projector group 101. The second projector 1B and the fourth projector 1D that project images onto the second area A2 are included in the second projector group 102. The first projector group 101 corresponds to the first image group 41, and the second projector group 102 corresponds to the second image group 42.

[0017] The first area A1 and the second area A2 are adjacent areas on the projection surface SC and partially overlap each other. Figures 1 and 2 show an example in which the first area A1 and the second area A2 overlap. In this example, the first image 3A and the second image 3B are tiled projected with portions of them overlapping each other to form a first whole image E1. Similarly, the third image 3C and the fourth image 3D are tiled projected to form a second whole image E2.

[0018] In the projection system 1000, the order of the first image 3A and the third image 3C and the order of the second image 3B and the fourth image 3D are not distinguished. Therefore, it can be said that the first image 3A and the fourth image 3D are tiled projected, and the second image 3B and the third image 3C are tiled projected. In other words, the combination of the image projected in the first area A1 and the image projected in the second area A2 is not unique. In this embodiment, the combination of images is set by user input, as described later.

[0019] In the first whole image E1, an overlapping region B1 where the first image 3A and the second image 3B overlap is subjected to a so-called edge blending process. The edge blending process is a process in which, for example, a dimming process is performed in the overlapping region B1 in the first image 3A where the second image 3B overlaps, thereby reducing the difference in brightness between the overlapping region and the non-overlapping region. Similarly, the edge blending process is performed in the overlapping region B2 where the third image 3C and the fourth image 3D overlap.

[0020] The control device 2 is a device having a data processing function and a communication function. The control device 2 is, for example, a PC (Personal Computer), a tablet computer, a smartphone, or other device. The control device 2 may be a device mounted on any of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D. In this case, the projector 1 that is mounted with the control device 2 among the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D may be referred to as a main projector.

[0021] The control device 2 is connected to each of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D so as to be able to communicate data with each other. The control device 2 is connected to the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D via, for example, a wired LAN (Local Area Network) or a wireless communication line, and executes communication. As the wireless communication line, for example, Wi-Fi, Bluetooth, or other wireless communication technology can be applied. Wi-Fi is a registered trademark. Bluetooth is a registered trademark. The control device 2 controls the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D.

[0022] [2. Projector configuration] In this embodiment, the configurations of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D are not limited, but in this embodiment, an example will be described in which the projectors have the same configuration.

[0023] 3 is a block diagram of the projector 1. The projector 1 includes a first operation unit 11, a light receiving unit 12, a first communication unit 13, a projection unit 14, a camera 15, a first storage unit 16, and a first processing unit 17.

[0024] The first operation unit 11 has an operator and receives an input operation from a user via the operator. The operator is, for example, various operation buttons, operation keys, or a touch panel. The first operation unit 11 is provided on the housing of the projector 1. The first operation unit 11 can also be called an input interface device.

[0025] The light receiving unit 12 has a light receiving element that receives an infrared signal from a remote controller (not shown) based on an input operation to the remote controller. The remote controller includes various operation buttons, operation keys, or a touch panel for receiving an input operation.

[0026] The first communication unit 13 is a communication device that communicates with the control device 2, and includes a transmitter and a receiver. The communication format between the first communication unit 13 and the control device 2 is a wired LAN as described above. Note that the communication format between the first communication unit 13 and the control device 2 is not limited to a wired LAN.

[0027] The projection unit 14 is an optical device that displays an image on the projection surface SC by projecting an image onto the projection surface SC. The projection unit 14 includes an image processing unit 141, a frame memory 142, a light valve driving unit 143, a light source 144, a red liquid crystal light valve 145R, a green liquid crystal light valve 145G, a blue liquid crystal light valve 145B, and a projection optical system 146. Hereinafter, when there is no need to distinguish between the red liquid crystal light valve 145R, the green liquid crystal light valve 145G, and the blue liquid crystal light valve 145B, they will be referred to as liquid crystal light valves 145.

[0028] The image processing unit 141 is configured with a single or multiple circuits such as an image processor. The image processing unit 141 receives an image signal from, for example, the first processing unit 17. The image processing unit 141 may receive an image signal from an image supply device. The image supply device is, for example, the control device 2. The image supply device may be a device different from the control device 2. The device different from the control device 2 is, for example, a PC. The image supply device is not limited to a PC, and may be, for example, a tablet terminal, a smartphone, a video playback device, a DVD (Digital Versatile Disc) player, a Blu-ray Disc player, a hard disk recorder, a television tuner device, or a video game console.

[0029] The image processing unit 141 expands the image signal in the frame memory 142. The frame memory 142 is configured by a storage device such as a RAM (Random Access Memory). The image processing unit 141 generates a drive signal by performing image processing on the image signal expanded in the frame memory 142.

[0030] The image processing performed by the image processing unit 141 includes, for example, geometric correction processing for correcting keystone distortion of an image projected by the projection unit 14. In addition to the geometric correction processing, the image processing unit 141 may perform other image processing, for example, resolution conversion processing. In the resolution conversion processing, the image processing unit 141 converts the resolution of an image indicated by an image signal to, for example, the resolution of the liquid crystal light valve 145. The other image processing is not limited to the resolution conversion processing. For example, the other image processing may be OSD processing for superimposing an OSD (On Screen Display) image on an image indicated by an image signal provided from an image supply device. The other image processing may be so-called gamma processing for performing gamma correction.

[0031] The light valve driving unit 143 is formed of, for example, a circuit such as a driver. The light valve driving unit 143 generates a driving voltage based on a driving signal provided from the image processing unit 141. The light valve driving unit 143 applies the driving voltage to the liquid crystal light valve 145, thereby driving the liquid crystal light valve 145.

[0032] The light source 144 is, for example, an LED (Light Emitting Diode). The light source 144 is not limited to an LED, and may be, for example, a xenon lamp, an extra-high pressure mercury lamp, or a laser light source. The light source 144 emits light. The light emitted from the light source 144 is incident on an integrator optical system (not shown). The integrator optical system reduces the variation in the luminance distribution of the incident light. After passing through the integrator optical system, the light emitted from the light source 144 is separated into red, green, and blue color light components, which are the three primary colors of light, by a color separation optical system (not shown). The red color light component is incident on a red liquid crystal light valve 145R. The green color light component is incident on a green liquid crystal light valve 145G. The blue color light component is incident on a blue liquid crystal light valve 145B.

[0033] The liquid crystal light valve 145 is composed of a liquid crystal panel or the like in which liquid crystal exists between a pair of transparent substrates. The liquid crystal light valve 145 has a rectangular pixel region 145a including a plurality of pixels 145p arranged in a matrix. In the liquid crystal light valve 145, a driving voltage based on an image signal is applied to the liquid crystal for each pixel 145p. When the light valve driving unit 143 applies a driving voltage to each pixel 145p, the light transmittance of each pixel 145p is set to a light transmittance based on the driving voltage. The light emitted from the light source 144 is modulated by passing through the pixel region 145a. Therefore, an image based on the image signal is formed for each color light. The liquid crystal light valve 145 is an example of a light modulation device.

[0034] The images of each color are synthesized for each pixel 145p by a color synthesis optical system (not shown). Thus, a color image is generated. The color image is projected via the projection optical system 146. The projection optical system 146 includes at least one lens. The projection optical system 146 may include a shiftable projection lens. In this case, the projection optical system 146 is shifted by a lens shift mechanism (not shown). The shift of the projection optical system 146 moves the position of the image projected from the projection optical system 146 on the projection surface SC. More specifically, the shift amount of the projection optical system 146 determines the movement amount of the image on the projection surface SC.

[0035] The camera 15 includes a light receiving optical system 151 such as a lens, and an image sensor 152 that converts light collected by the light receiving optical system 151 into an electrical signal. The image sensor 152 is, for example, a CCD (Charge Coupled Device) image sensor that receives light in the infrared region and the visible light region. The image sensor 152 is not limited to a CCD image sensor, and may be, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor that receives light in the infrared region and the visible light region.

[0036] The camera 15 captures the projection surface SC to generate imaging data. The camera 15 of the first projector 1A and the camera 15 of the third projector 1C capture the first area A1. When the third projector 1C projects a black image as the third image 3C, the camera 15 of the first projector 1A captures the first image 3A. When the first projector 1A projects a black image as the first image 3A, the camera 15 of the third projector 1C captures the third image 3C. The camera 15 of the second projector 1B and the camera 15 of the fourth projector 1D capture the second area A2. When the fourth projector 1D projects a black image as the fourth image 3D, the camera 15 of the second projector 1B captures the second image 3B. When the second projector 1B projects a black image as the second image 3B, the camera 15 of the fourth projector 1D captures the fourth image 3D. Here, the black image refers to an image projected by the projector 1 based on an image signal that makes the entire image black. For example, when the first projector 1A projects a black image, the first image 3A is an image that is entirely black.

[0037] The imaging data generated by the camera 15 is transmitted to the control device 2 by the first communication unit 13. The camera 15 of the first projector 1A generates first imaging data. The camera 15 of the second projector 1B generates second imaging data, the camera 15 of the third projector 1C generates third imaging data, and the camera 15 of the fourth projector 1D generates fourth imaging data. The first imaging data, second imaging data, third imaging data, and fourth imaging data are each transmitted to the control device 2.

[0038] The camera 15 may be provided separately from the projector 1. In this case, the camera 15 and the projector 1 are connected to each other via a wired or wireless interface so as to be able to send and receive data.

[0039] The first storage unit 16 is a recording medium that stores data and programs readable by the first processing unit 17. The first storage unit 16 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), or an Electrically Erasable Programmable ROM (EEPROM). The volatile memory is, for example, a RAM.

[0040] The first storage unit 16 stores a control program executed by the first processing unit 17 and various data used by the first processing unit 17.

[0041] The first processing unit 17 is configured by, for example, one or more processors. As an example, the first processing unit 17 is configured by one or more central processing units (CPUs). A part or all of the functions of the first processing unit 17 may be realized by a circuit such as a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The first processing unit 17 executes various processes in parallel or sequentially. The first processing unit 17 reads a control program from the first storage unit 16. The first processing unit 17 executes the control program to realize an operation control unit 171 and a correction unit 172.

[0042] The operation control unit 171 controls various operations of the projector 1. For example, the operation control unit 171 controls the first communication unit 13, the projection unit 14, and the camera 15.

[0043] As an example, the operation control unit 171 controls the image processing unit 141, the light valve driving unit 143, and the light source 144 to cause the projection unit 14 to project an image. The operation control unit 171 causes the camera 15 to capture an image. The operation control unit 171 causes the first communication unit 13 to transmit the captured image data to the control device 2.

[0044] Correction section 172 corrects the image quality of the image projected from projection section 14. Correction section 172 corrects the brightness and color of the image, for example, by controlling image processing section 141 in accordance with various correction data.

[0045] In the initial state, the correction unit 172 causes the image processing unit 141 to correct the image signal based on preset initial brightness correction data, thereby correcting the brightness of the image projected by the projection unit 14 from the brightness indicated by the image signal before correction to the brightness indicated by the image signal after correction. The initial brightness correction data is set before the shipment of the projector 1 and stored in the first storage unit 16 in order to reduce deviations from a standard in the brightness of the image due to individual differences in the projector 1, for example.

[0046] When there are brightness correction data provided by the control device 2 (to be described later) and initial brightness correction data, the correction unit 172 causes the image processing unit 141 to correct the image signal based on the initial brightness correction data and the brightness correction data provided by the control device 2, thereby correcting the brightness of the image projected by the projection unit 14 from the brightness indicated by the image signal before correction to the brightness indicated by the image signal after correction. Furthermore, when there is user-defined brightness correction data set by the user in addition to the brightness correction data provided by the control device 2 (to be described later) and the initial brightness correction data, the correction unit 172 may perform correction using these. Specifically, the correction unit 172 causes the image processing unit 141 to correct the image signal based on the initial brightness correction data, the user-defined brightness correction data, and the brightness correction data provided by the control device 2. Therefore, the brightness of the image projected by the projection unit 14 changes from the brightness indicated by the image signal before correction to the brightness indicated by the image signal after correction. The user-defined brightness correction data is set by the user when the user adjusts the brightness of the image.

[0047] In the initial state, the correction unit 172 causes the image processing unit 141 to correct the image signal based on preset initial color correction data, thereby correcting the color of the image projected by the projection unit 14 from the color indicated by the image signal before correction to the color indicated by the image signal after correction. The initial color correction data is set before the projector 1 is shipped and stored in the first storage unit 16 in order to reduce deviations from a standard in the color of an image due to individual differences in the projector 1, for example.

[0048] When there is color correction data provided by the control device 2, the correction unit 172 causes the image processing unit 141 to correct the image signal based on the initial color correction data and the color correction data provided by the control device 2, thereby correcting the color of the image projected by the projection unit 14 from the color indicated by the image signal before correction to the color indicated by the image signal after correction. Furthermore, when there is user-defined color correction data set by the user in addition to the color correction data provided by the control device 2 and the initial color correction data, the correction unit 172 may perform correction using these. Specifically, the correction unit 172 causes the image processing unit 141 to correct the image signal based on the initial color correction data, the user-defined color correction data, and the color correction data provided by the control device 2. As a result, the color of the image projected by the projection unit 14 changes from the color indicated by the image signal before correction to the color indicated by the image signal after correction. The user-defined color correction data is set by the user when the user adjusts the color of the image.

[0049] [3. Control device configuration] 4 is a diagram showing an example of the control device 2. The control device 2 includes a second operation unit 21, a second communication unit 22, a second storage unit 23, and a second processing unit 24.

[0050] The second operation unit 21 is, for example, a keyboard, an operation button, or a touch panel. The second operation unit 21 accepts an input operation by a user. The second operation unit 21 can also be called an input interface device.

[0051] The second communication unit 22 is a communication device that communicates with each of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D, and includes a transmitter and a receiver. Specifically, the second communication unit 22 communicates with the first communication unit 13 via a wired LAN. The communication format between the second communication unit 22 and the first communication unit 13 is not limited to the wired LAN. The second communication unit 22 receives the first imaging data, the second imaging data, the third imaging data, and the fourth imaging data.

[0052] The second storage unit 23 is a recording medium that stores programs and data readable by the second processing unit 24. The second storage unit 23 includes, for example, a non-volatile memory and a volatile memory. The second storage unit 23 stores a control program 231 executed by the second processing unit 24 and various data referenced or processed by the second processing unit 24.

[0053] The second processing unit 24 is configured, for example, by one or more processors. As an example, the second processing unit 24 is configured by one or more CPUs. Some or all of the functions of the second processing unit 24 may be realized by circuits such as DSP, ASIC, PLD, FPGA, etc. The second processing unit 24 executes various processes in parallel or sequentially. The second processing unit 24 reads a control program 231 from the second storage unit 23. The second processing unit 24 executes the control program 231 to realize an input / output control unit 241, a brightness estimation unit 242, a brightness correction unit 243, a color estimation unit 244, a color correction unit 245, and an instruction unit 246.

[0054] The input / output control unit 241 executes communication with the projector 1, and acquires, via the second communication unit 22, the first imaging data, the second imaging data, the third imaging data, the fourth imaging data, and other data transmitted by the projector 1.

[0055] The brightness estimation unit 242 estimates the brightness of the first image 3A projected by the first projector 1A. Similarly, the brightness estimation unit 242 estimates the brightness of the second image 3B, the brightness of the third image 3C, and the brightness of the fourth image 3D.

[0056] The brightness correction unit 243 calculates a correction value when correction of the brightness of one or more of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D is necessary based on the brightness estimated by the brightness estimation unit 242. When there is a projector 1 for which correction is not performed, it is not necessary to calculate a correction value for that projector 1, or a correction value may be determined with the correction amount set to zero. Furthermore, the brightness correction unit 243 may calculate correction values ​​for all projectors 1. When the brightness correction unit 243 calculates the correction value, it generates brightness correction data based on the calculated correction value and transmits the brightness correction data to one or more of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D. The brightness correction unit 243 causes the projector 1 to perform brightness adjustment based on the brightness correction data. The brightness correction data corresponds to an example of a brightness correction value.

[0057] The color estimation unit 244 estimates the color of the first image 3A projected by the first projector 1A. Similarly, the color estimation unit 244 estimates the color of the second image 3B, the color of the third image 3C, and the color of the fourth image 3D.

[0058] The color correction unit 245 calculates a correction value when color correction is required for one or more of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D based on the estimation result of the color estimation unit 244. When there is a projector 1 for which correction is not performed, it is not necessary to calculate a correction value for that projector 1, or a correction value may be determined with the correction amount set to zero. Also, correction values ​​may be calculated for all projectors 1. When the color correction unit 245 calculates the correction value, it generates color correction data based on the calculated correction value and transmits the color correction data to one or more of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D. The color correction unit 245 causes the projector 1 to perform color adjustment based on the color correction data. The color correction data corresponds to an example of a color correction value.

[0059] The instruction unit 246 sends instructions to each of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D. For example, the instruction unit 246 instructs the projector 1 to project a luminance measurement pattern and to project a black image in a brightness adjustment process described below. Also, for example, the instruction unit 246 instructs the projector 1 to project a chromaticity measurement pattern and to project a black image in a color adjustment process described below. The instruction unit 246 issues instructions to the projector 1 by, for example, transmitting a command to the projector 1.

[0060] [4. Projection system operation] 5, 6 and 7 are flowcharts showing the operation of the projection system 1000. The operation of the projection system 1000 will be described with reference to these flowcharts.

[0061] The operation of FIG. 5 is executed by the second processing unit 24. The control device 2 judges whether or not an instruction to perform brightness adjustment has been given (step S11). When an input instructing the execution of brightness adjustment is received by the user operating the second operation unit 21, when control data indicating that an input instructing the execution of brightness adjustment has been received by the user operating the first operation unit 11 is received from the projector 1, or when a preset condition for executing brightness adjustment is met, it is judged that an instruction to perform brightness adjustment has been given (step S11; YES). When an instruction to perform brightness adjustment has not been given (step S11; NO), the control device 2 proceeds to step S13 described later.

[0062] When it is determined that an instruction to perform brightness adjustment has been issued (step S11; YES), the control device 2 executes brightness adjustment processing (step S12). The brightness adjustment processing in step S12 is processing for eliminating or reducing uneven brightness in the projected image P by reducing the difference between the brightness of the first projector group 101 and the brightness of the second projector group 102. The details of the brightness adjustment processing will be described later. After executing the brightness adjustment, the control device 2 proceeds to step S13.

[0063] In step S13, the control device 2 judges whether or not the user has instructed to perform color adjustment (step S13). When the second operation unit 21 has been operated, when control data indicating that the first operation unit 11 has been operated has been received from the projector 1, or when a preset condition for performing color adjustment is met, it is judged that the user has instructed to perform color adjustment (step S13; YES). When the user has not instructed to perform color adjustment (step S13; NO), the control device 2 ends this process. The operation of FIG. 5 is executed by the control device 2 at a preset timing or at a predetermined time interval.

[0064] When the control device 2 determines that the execution of color adjustment has been instructed (step S13; YES), it accepts an input regarding the combination of the projectors 1 (step S14). The control device 2 executes color adjustment based on the combination of two projectors 1. The combination of the projectors 1 is not limited as long as it is a combination of a projector 1 that projects an image in the first area A1 and a projector 1 that projects an image in the second area A2. In this embodiment, it is possible to combine any one of the first projector 1A and the third projector 1C with any one of the second projector 1B and the fourth projector 1D. In step S14, an input to select any one of the first projector 1A and the third projector 1C and an input to select any one of the second projector 1B and the fourth projector 1D are accepted. Here, an example will be described in which the first projector 1A and the second projector 1B are selected. The selected first projector 1A and the second projector 1B constitute one combination. The control device 2 sets the unselected projector 1 as another combination. In this embodiment, the third projector 1C and the fourth projector 1D are selected as another combination. The input in step S14 is, for example, accepting an input specifying a combination by a user operating the second operating unit 21, or receiving control data from the projector 1 indicating that an input specifying a combination has been accepted by operating the first operating unit 11.

[0065] The control device 2 selects the first projector 1A and the second projector 1B in accordance with the input in step S14 (step S15). The control device 2 executes color adjustment processing for the selected first projector 1A and second projector 1B (step S16). The color adjustment processing is processing for adjusting one or more colors of the first projector 1A and the second projector 1B so as to match the colors of the first image 3A projected by the first projector 1A and the second image 3B projected by the second projector 1B. The color adjustment processing will be described later.

[0066] The control device 2 selects a combination of projectors 1 other than the projector 1 selected in accordance with the input in step S14 (step S17). Specifically, the control device 2 selects the third projector 1C and the fourth projector 1D. The control device 2 executes color adjustment processing for the selected third projector 1C and fourth projector 1D (step S18). The color adjustment processing in step S18 is similar to that in step S16, except that the color adjustment processing targets the third projector 1C and the fourth projector 1D.

[0067] In this way, the control device 2 executes the brightness adjustment of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D based on the brightness of the first projector group 101 and the second projector group 102. As a result, the difference in brightness between the first image group 41 and the second image group 42 is corrected, so that the unevenness in the overall brightness of the projected image P can be eliminated or reduced. This operation has an advantage over the case where the brightness of the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D is adjusted individually. In other words, since an event where the brightness of the other projectors 1 is reduced to match the darkest projector 1 is unlikely to occur, the degree to which the brightness of the projected image P is reduced due to the brightness adjustment can be reduced.

[0068] Furthermore, the control device 2 executes color adjustment processing for a combination of one projector 1 that projects an image into the first area A1 and one projector 1 that projects an image into the second area A2. For example, the control device 2 executes color adjustment processing for different combinations of projectors 1 in steps S16 and S18. As a result of step S16, color unevenness in the first overall image E1 is eliminated or reduced, and in step S18, color unevenness in the second overall image E2 is eliminated or reduced. Therefore, color unevenness in the projected image P in which the first overall image E1 and the second overall image E2 are superimposed is eliminated or reduced, so that color adjustment of the entire projected image P is appropriately executed.

[0069] In the color adjustment process of step S16, as described below, information indicating the color of the third image 3C and information indicating the color of the fourth image 3D are not used. Therefore, there is no need to obtain or process information indicating the color of all of the first image 3A, the second image 3B, the third image 3C, and the fourth image 3D, which has the advantage of reducing the processing load. Similarly, in step S18, the control device 2 does not use information indicating the color of the first image 3A and information indicating the color of the second image 3B. Therefore, there is the advantage of reducing the processing load.

[0070] Changing the brightness of an image projected by the projector 1 may change the color of the image projected by the projector 1. For this reason, if a brightness adjustment process is executed after a color adjustment process, there is a possibility that the color adjustment process will need to be redone in response to the color change that occurs in the brightness adjustment process. In this embodiment, as shown in FIG. 5, the brightness adjustment process is executed before the color adjustment process, so there is a low possibility that the color adjustment process will need to be redone, which is efficient.

[0071] Fig. 6 is a flowchart showing in detail the brightness adjustment process of step S12. Steps S21-S28 in Fig. 6 are executed by the color estimation unit 244 and the instruction unit 246. Steps S29-S31 are executed by the brightness estimation unit 242, and steps S32-S36 are executed by the brightness correction unit 243.

[0072] When starting the operation of FIG. 6, the control device 2 selects either the first projector group 101 or the second projector group 102, and selects one projector 1 in the selected projector group.

[0073] The control device 2 causes the selected projector 1 to project a luminance measurement pattern by the instruction unit 246 giving an instruction (step S21). As the luminance measurement patterns, for example, a green image in which the entire image projected by the projector 1 is green, a red image in which the entire image projected by the projector 1 is red, and a blue image in which the entire image projected by the projector 1 is blue are prepared in advance. The luminance measurement patterns of the green image, the red image, and the blue image are all raster images with the maximum gradation value. For example, when the projector 1 has a gradation value of 1024 steps, the luminance measurement pattern of the green image is an image in which the green gradation value of all the pixels 145p constituting the projected image is 1023. The same is true for the luminance measurement patterns of the red image and the blue image. The projector 1 may store display data for displaying these luminance measurement patterns in the first storage unit 16 in advance.

[0074] In step S21, when one projector 1 projects a luminance measurement pattern in accordance with an instruction from the control device 2, the other projectors 1 project a black image. This prevents confusion of projected light in the luminance measurement pattern.

[0075] After the selected projector 1 starts projecting the luminance measurement pattern, the control device 2 executes measurement of the luminance measurement pattern (step S22). In step S22, the control device 2 instructs the projector 1 to capture an image and acquires captured image data. The projector 1 that executes the image capture is preferably the projector 1 selected in step S21, but another projector 1 may execute the image capture.

[0076] The control device 2 acquires measurement values ​​from the acquired imaging data. The measurement values ​​are RGB data of the coordinates of a measurement point designated in advance in the imaging data. The control device 2 may acquire RGB data of a pixel designated by the coordinates of the measurement point and RGB data of a predetermined number of pixels around the measurement point, and acquire the average value of these as the measurement value. There is no limit to the number of measurement points, and for example, measurement values ​​of 10 measurement points may be acquired from one imaging data. The measurement values ​​acquired by the control device 2 in step S22 are information indicating the brightness of the projected image P. Specifically, the measurement values ​​of the luminance measurement pattern of the first projector 1A are information indicating the brightness of the first projector 1A, and the measurement values ​​of the luminance measurement pattern of the second projector 1B are information indicating the brightness of the second projector 1B. The measurement values ​​of the luminance measurement pattern of the third projector 1C are information indicating the brightness of the third projector 1C, and the measurement values ​​of the luminance measurement pattern of the fourth projector 1D are information indicating the brightness of the fourth projector 1D.

[0077] The control device 2 judges whether or not the projector 1 selected in step S21 has measured all colors using the luminance measurement patterns of the green image, red image, and blue image (step S23). If it is judged that the measurement of all colors has not been completed (step S23; NO), the control device 2 changes the color of the luminance measurement pattern projected by the projector 1 (step S24), and proceeds to step S21 to continue the measurement.

[0078] When it is determined that all the colors of the green, red, and blue images have been measured (step S23; YES), the control device 2 determines whether or not all the projectors 1 included in the selected projector group have been measured (step S25).When it is determined that all the projectors 1 have not been measured (step S25; NO), the control device 2 changes the selected projector 1 (step S26) and returns to step S21 to continue the measurement.

[0079] When it is determined that all projectors 1 have been measured (step S25; YES), the control device 2 determines whether or not all projector groups that project onto the projection surface SC have been measured (step S27). When it is determined that all projector groups have not been measured (step S27; NO), the control device 2 changes the selected projector group (step S28) and returns to step S21 to continue the measurement.

[0080] When it is determined that all projector groups have been measured (step S27; YES), the control device 2 proceeds to step S29. The measurement values ​​obtained from the imaging data are RGB values ​​at multiple measurement points for each projector 1. The control device 2 performs RGB-XYZ conversion on the measurement values ​​(step S29). As a result, data of XYZ, which are tristimulus values, is obtained as the measurement values ​​of the brightness of each projector 1. Furthermore, in step S29, the control device 2 calculates the average XYZ value of the entire image projected on the projection surface SC for each projector 1. For example, the control device 2 calculates the average XYZ value of the entire first image 3A by calculating the average of the XYZ values ​​of multiple measurement points, which are the measurement values ​​of the first projector 1A. The control device 2 performs the same process for the second projector 1B, the third projector 1C, and the fourth projector 1D. By the process of step S30, the luminance Y when the gradation value of the projector 1 is maximized is obtained for each projector 1.

[0081] The control device 2 calculates a predicted value of the luminance after the color adjustment is performed based on the average XYZ value obtained in step S29 (step S30). The color adjustment refers to, for example, the color adjustment process in steps S16 and S18. In the color adjustment process, the balance of RGB of the projection light of the projector 1 is corrected to be in an appropriate state. Therefore, if the balance of RGB of the measured value is in an extreme state at the time of performing the brightness adjustment process, the brightness of the projection light of the projector 1 may be affected by the large correction performed in the color adjustment process. Therefore, the control device 2 assumes that the color adjustment process is performed after the brightness adjustment process of FIG. 6, predicts the luminance after performing this assumed color adjustment process, and obtains a predicted value. Specifically, in step S31, the control device 2 calculates the value of luminance Y in a state where the output balance of RGB is appropriate as a predicted value.

[0082] For example, the control device 2 multiplies the Y value calculated from the R measurement value, the Y value calculated from the G measurement value, and the Y value calculated from the B measurement value by a coefficient prepared in advance, and then adds these Y values ​​together to calculate a predicted value of brightness Y for each projector 1.

[0083] Next, the control device 2 adds up the predicted value of the luminance Y of each projector 1 obtained in step S30 for each projector group (step S31). Specifically, the control device 2 calculates the predicted value of the luminance Y of the first projector group 101 by adding up the predicted value of the luminance Y of the first projector 1A and the predicted value of the luminance Y of the third projector 1C. The control device 2 performs similar processing for the second projector 1B and the fourth projector 1D to calculate the predicted value of the luminance Y of the second projector group 102. The predicted value of the luminance Y of the first projector group 101 is information indicating the first brightness of the first image group 41, and the predicted value of the luminance Y of the second projector group 102 is information indicating the second brightness of the second image group 42.

[0084] Next, the control device 2 calculates the maximum luminance that can be set for each projector group based on the predicted value of the luminance Y of each projector group obtained in step S31 and the setting state of the light source 144 in the projector 1 at the time of measurement (step S32). The maximum luminance that can be set is an estimated value of the luminance Y obtained when the brightness of the light source 144 of all the projectors 1 included in the projector group is maximized. The maximum brightness here may be the upper limit of the capacity of the light source 144 of the projector 1, or may be the maximum value of the brightness under a predetermined condition that takes into account the image quality and the like. For example, it may be up to 1.3 times the current brightness, up to 1.1 times the current brightness, or the like. In this case, the brightness of the light source 144 does not exceed the upper limit of the capacity.

[0085] The control device 2 determines the target brightness of each projector group by comparing the maximum settable brightness of the first projector group 101 with the maximum settable brightness of the second projector group 102 (step S33). For example, the control device 2 sets the target brightness according to the total of the maximum settable brightness of the first projector group 101 or the second projector group 102, whichever has the lower total of the maximum settable brightness. For example, the control device 2 makes the target brightness of the brighter projector group darker than the brightness before adjustment, based on the ratio between the brightness of the first projector group 101 and the brightness of the second projector group 102. This makes it possible to eliminate uneven brightness in the projected image P and maximize the brightness of the projected image P.

[0086] The control device 2 calculates the brightness level of the light source 144 of the projector 1 based on the value of the target brightness (step S34). In step S34, the control device 2 calculates the brightness level of the first projector 1A and the brightness level of the third projector 1C based on the target brightness of the first projector group 101 calculated in step S33. In addition, the control device 2 calculates the brightness level of the second projector 1B and the brightness level of the fourth projector 1D based on the target brightness of the second projector group 102. For example, for the projector 1 included in the relatively bright projector group among the first projector group 101 and the second projector group 102, the control device 2 calculates the brightness level of each projector 1 based on the ratio between the target brightness based on the ratio between the brightness of the first projector group 101 and the brightness of the second projector group 102 and the estimated value of the brightness Y of each projector 1. For the projector 1 included in the relatively dark projector group, the control device 2 determines the maximum settable brightness of each projector 1 as the brightness level of the projector 1.

[0087] The control device 2 generates brightness correction data for the projector 1 based on the brightness level of the projector 1 obtained in step S34 (step S35). For example, the control device 2 generates brightness correction data for the first projector 1A based on the brightness level of the first projector 1A. Similarly, the control device 2 generates brightness correction data for the second projector 1B, the third projector 1C, and the fourth projector 1D.

[0088] The control device 2 transmits the brightness correction data generated in step S35 to each projector 1, and causes the projectors 1 to execute brightness correction (step S36).

[0089] Fig. 7 is a flowchart showing in detail the color adjustment process of steps S16 and S18. Steps S41-S49 in Fig. 7 are executed by the brightness estimation unit 242 and the instruction unit 246. Steps S50-S51 are executed by the color estimation unit 244, and steps S52-S58 are executed by the color correction unit 245.

[0090] 7, the control device 2 selects one of the multiple projectors 1 included in the combination to be processed. The control device 2 also selects the color of the chromaticity measurement pattern and the initial value of the gradation value of the chromaticity measurement pattern.

[0091] The control device 2 causes the selected projector 1 to project a chromaticity measurement pattern by the instruction unit 246 giving an instruction (step S41). For example, a green image, a red image, and a blue image are prepared in advance as the chromaticity measurement patterns. The green image, the red image, and the blue image are images in which the entire image projected by the projector 1 is a single color, for example, raster images, similar to the luminance measurement pattern. A plurality of chromaticity measurement patterns with different gradation values ​​are prepared for each of the green image, the red image, and the blue image. For example, the projector 1 can switch and project seven chromaticity measurement patterns with red gradation values ​​of 150, 300, 450, 600, 750, 900, and 1023 according to an instruction from the control device 2. Similarly, the projector 1 can project a plurality of chromaticity measurement patterns with different gradation values ​​for the green image and the blue image. The projector 1 may store display data for displaying these chromaticity measurement patterns in the first storage unit 16 in advance. In step S41, the control device 2 causes the projector 1 to project a chromaticity measurement pattern of a color selected from the green image, red image, and blue image, the chromaticity measurement pattern having a selected gradation value.

[0092] In step S21, when one projector 1 projects a chromaticity measurement pattern in accordance with an instruction from the control device 2, the other projectors 1 project a black image. This prevents confusion of the projected light in the chromaticity measurement pattern.

[0093] After the selected projector 1 starts projecting the chromaticity measurement pattern, the control device 2 executes measurement of the chromaticity measurement pattern (step S42). In step S42, the control device 2 instructs the projector 1 to capture an image and acquires captured image data. The projector 1 that executes the image capture is preferably the projector 1 selected in step S41, but another projector 1 may execute the image capture. The control device 2 acquires measurement values ​​from the acquired imaging data. The measurement values ​​are RGB data of the coordinates of a measurement point designated in advance in the imaging data. The control device 2 may acquire RGB data of a pixel designated by the coordinates of the measurement point and RGB data of a predetermined number of pixels around the measurement point, and acquire the average value of these as the measurement value. There is no limit to the number of measurement points, and for example, measurement values ​​of 10 measurement points may be acquired from one imaging data.

[0094] The measurement values ​​obtained from the imaging data are RGB values ​​at multiple measurement points. The control device 2 performs RGB-XYZ conversion on the measurement values ​​measured in step S42 (step S43). This provides XYZ data at multiple measurement points as the measurement values ​​of the color of the selected projector 1.

[0095] The control device 2 judges whether or not the projector 1 selected in step S41 has measured all the colors using the chromaticity measurement patterns of the green image, red image, and blue image (step S44). If it is judged that the measurement of all the colors has not been completed (step S44; NO), the control device 2 changes the color of the chromaticity measurement pattern projected by the projector 1 (step S45), and proceeds to step S41 to continue the measurement.

[0096] When it is determined that all the colors of the green image, red image, and blue image have been measured (step S44; YES), the control device 2 determines whether or not all the projectors 1 included in the selected combination have been measured (step S46).When it is determined that all the projectors 1 have not been measured (step S46; NO), the control device 2 changes the selected projector 1 (step S47) and returns to step S41 to continue the measurement.

[0097] When it is determined that all projectors 1 have been measured (step S46; YES), the control device 2 determines whether or not measurements using chromaticity measurement patterns of all gradations have been completed (step S48). When it is determined that measurements using chromaticity measurement patterns of all gradations have not been completed (step S48; NO), the control device 2 changes the gradation value of the chromaticity measurement pattern (step S49) and returns to step S41 to continue the measurements.

[0098] The measurement values ​​obtained in steps S41-S49 correspond to information indicating the color of the image projected by the projector 1. For example, the measurement values ​​of the chromaticity measurement pattern of the first projector 1A are information indicating the color of the first image 3A. The measurement values ​​of the chromaticity measurement pattern of the second projector 1B are information indicating the color of the second image 3B. The measurement values ​​of the chromaticity measurement pattern of the third projector 1C are information indicating the color of the third image 3C. The measurement values ​​of the chromaticity measurement pattern of the fourth projector 1D are information indicating the color of the fourth image 3D.

[0099] When it is determined that measurements using the chromaticity measurement patterns of all gradations have been completed (step S48; YES), the control device 2 performs a validity determination of the measurement points (step S50). In step S50, the control device 2 determines the validity of the measurement values ​​obtained from the imaging data for each measurement point. When performing the processing of step S50, the control device 2 has measurement values ​​for multiple measurement points using the chromaticity measurement patterns of each gradation of green, red, and blue, and these measurement values ​​are in an XYZ converted state.

[0100] There are five examples of the method of determination in step S50. As a first determination method, when the control device 2 fails to convert a measurement value from RGB to XYZ, it determines that the measurement point corresponding to the measurement value is an invalid measurement point.

[0101] As a second judgment method, the control device 2 compares measurement values ​​obtained by measuring chromaticity measurement patterns of the same color but different gradation values, and judges as invalid any measurement value that does not have a relationship in which the XYZ values ​​are greater as the gradation value increases. For example, the control device 2 has X values, Y values, and Z values ​​of seven green images measured at seven gradations. The control device 2 compares the seven X values ​​and judges whether or not these seven X values ​​show a correlation in which the X value is greater as the gradation value increases. The control device 2 makes a similar judgment for the Y value and the Z value. Furthermore, the control device 2 makes a similar judgment for the XYZ values ​​of the red image and the XYZ values ​​of the blue image. If there is a measurement value that does not conform to the above correlation for any of the X value, Y value, and Z value in any of the green image, red image, and blue image, the control device 2 determines that the measurement point corresponding to that measurement value is an invalid measurement point.

[0102] As a third judgment method, the control device 2 judges whether or not the balance of the XYZ values ​​of the green image, red image, and blue image at one gradation value of one color matches the color of the chromaticity measurement pattern. For example, if the Y value in the measurement value of the green image is higher than the X value and the Z value, the X value in the measurement value of the red image is higher than the Y value and the Z value, and the Z value in the measurement value of the blue image is higher than the X value and the Y value, the balance of the XYZ values ​​matches the color of the chromaticity measurement pattern. The control device 2 compares the X value, the Y value, and the Z value included in the measurement value, and if the balance of the XYZ values ​​does not match the color of the chromaticity measurement pattern, judges the measurement point corresponding to this measurement value to be an invalid measurement point.

[0103] As a fourth judgment method, the control device 2 judges whether the difference between the measurement value of any measurement point and the measurement value of an adjacent measurement point is within a predetermined range. This judgment is performed, for example, for each of the X value, Y value, and Z value. The control device 2 judges a measurement point whose difference with the measurement value of an adjacent measurement point exceeds the predetermined range to be an invalid measurement point.

[0104] As a fifth judgment method, the control device 2 invalidates measurement points that are highly likely to be affected by spot light. Spot light refers to light projected by a projector 1 adjacent to the projector 1 performing the measurement, reflected by the projection surface SC. In step S50, for example, the control device 2 extracts the Y value of the chromaticity measurement pattern with the highest gradation value in the green image from the measurement values ​​of all measurement points, and finds the median of the Y values. The control device 2 determines a predetermined number of measurement values ​​whose Y values ​​are farthest from the median as invalid measurement values, and invalidates the measurement points corresponding to the invalid measurement values.

[0105] In step S50, the control device 2 performs a validity determination of the measurement points using any one of the above-mentioned first to fifth determination methods or a combination of a plurality of determination methods. For example, the control device 2 performs a determination using the first to fourth determination methods for all measurement points, and invalidates the measurement points that are determined to be invalid by any one of the determination methods. Furthermore, for example, the control device 2 may perform a determination using the fifth determination method for the measurement points that are determined to be valid by all of the first to fourth determination methods. In this case, the measurement points that are determined to be valid by the fifth determination method may be determined to be valid measurement points. In addition, the control device 2 may perform a determination using the first to fifth determination methods for all measurement points, and may perform a validity determination of the measurement points by tallying up the validity and invalidity determination results for each determination method. For example, a measurement point that has been determined to be invalid the number of times equal to or greater than a threshold value may be determined to be an invalid measurement point.

[0106] The control device 2 acquires the measurement values ​​of the measurement points determined to be valid in step S50 (step S51). The control device 2 calculates the average XYZ values ​​for each region of the projection surface SC based on the acquired measurement values ​​for each projector 1. That is, the control device 2 calculates the average X value, the average Y value, and the average Z value of the first region A1, and calculates the average X value, the average Y value, and the average Z value of the second region A2.

[0107] The control device 2 determines the target color by comparing the average XYZ values ​​of the multiple projectors 1 (step S53). For example, the control device 2 sets one of the multiple projectors 1 belonging to the combination to be processed as a reference projector. The control device 2 determines the target color of the reference projector 1 so as to match the corrected target chromaticity of all the projectors 1 belonging to the combination to be processed. The corrected target chromaticity indicates an appropriate balance of XYZ values, and is, for example, the XYZ value when the projector 1 projects a white image with an appropriate color tone. The white image refers to an image projected by the projector 1 based on an image signal that makes the entire image white. For example, when the first projector 1A projects a white image, the first image 3A becomes an image that is entirely white. Next, the control device 2 determines the target color of the other projectors 1 belonging to the combination to be processed so as to match the target color of the reference projector 1.

[0108] The control device 2 calculates the output characteristics of the liquid crystal light valve 145 for each projector 1 based on the XYZ values, which are measurement values ​​obtained by a chromaticity measurement pattern of multiple gradation values ​​(step S54). The output characteristics refer to, for example, the ratio of the X value, the Y value, and the Z value of the liquid crystal light valve 145. In step S54, the control device 2 calculates the output characteristics of each of the red liquid crystal light valve 145R, the green liquid crystal light valve 145G, and the blue liquid crystal light valve 145B for each projector 1.

[0109] The control device 2 calculates a color unevenness correction value for each projector 1 based on the target color calculated in step S53 and the output characteristics of the liquid crystal light valve 145 calculated in step S54 (step S55). The color unevenness correction value is a correction value for correcting color unevenness within the plane of the image projected by the projector 1, and is calculated for each coordinate of the image. The coordinates in the image projected by the projector 1 using the projection unit 14 correspond to the coordinates of the pixels in the liquid crystal light valve 145.

[0110] The control device 2 generates color correction data for each projector 1 based on the color unevenness correction value (step S56). The control device 2 transmits the color correction data generated in step S56 to each projector 1, and causes each projector 1 to execute color correction (step S57).

[0111] 7 for the combination of the first projector 1A and the second projector 1B in step S16, and adjusts the colors of the first image 3A and the second image 3B. Similarly, in step S18, the projection system 1000 adjusts the colors of the third image 3C and the fourth image 3D by performing the operation of Fig. 7 for the combination of the third projector 1C and the fourth projector 1D. This adjusts the overall color of the projected image P.

[0112] 5. Other embodiments The above-described embodiment is a preferred embodiment of the present invention, but the present invention is not limited to this embodiment and various modifications are possible without departing from the spirit of the present invention.

[0113] In the above embodiment, a configuration in which four projectors 1 are used to project images onto a first area A1 and a second area A2 of the projection surface SC is exemplified, but this is just one example, and the present disclosure can also be applied to a configuration in which five or more projectors 1 are used to project images onto three or more areas of the projection surface SC.

[0114] In the above embodiment, the projection unit 14 of the projector 1 is configured to modulate light by the liquid crystal light valve 145 configured as a transmissive liquid crystal panel, but this is just one example. For example, the projector 1 may be configured to modulate light by a reflective liquid crystal panel, or may be configured to include a digital micromirror device.

[0115] Each functional unit shown in Figures 3 and 4 shows a functional configuration, and the specific implementation form is not particularly limited. It is not necessary to implement hardware that corresponds to each functional unit shown in the figures, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. In addition, some of the functions realized by software in each of the above embodiments may be realized by hardware, and some of the functions realized by hardware may be realized by software.

[0116] 5, 6, and 7 are divided according to the main processing contents in order to facilitate understanding of the processing in the projection system 1000, and the present invention is not limited by the manner in which the processing units are divided or the names of the processing units. These processes can be further divided into more processing units according to the processing contents, or one processing unit can be divided to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the figures.

[0117] The control program 231 can be recorded, for example, on a recording medium that is recorded so as to be readable by the second processing unit 24. As the recording medium, a magnetic or optical recording medium or a semiconductor memory device can be used. Specific examples include portable or fixed recording media such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), a DVD, a Blu-ray disk, a magneto-optical disk, a flash memory, and a card-type recording medium. In addition, the above-mentioned control method can be realized by storing these programs in a server device or the like and downloading the control program 231 from the server device.

[0118] 6. Summary of this Disclosure The following is a summary of this disclosure. (Appendix 1) An information processing method comprising: determining a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group different from the first projector group, and determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first region by the first projector and a color of a second image projected onto the second region by a second projector included in the second projector group. As a result, when adjusting the brightness and color of a projected image, the brightness of the projector can be determined based on the brightness of the first image group and the second image group, so that the influence of the brightness of one projector in the process of adjusting the brightness of the projected image can be reduced. Therefore, even if the first projector group or the second projector group includes a projector with low brightness, the adjustment can be performed without significantly impairing the brightness of the projected image. Also, by determining at least one of the correction value of the color used by the first projector and the correction value of the color used by the second projector based on the color of the first image and the color of the second image, color unevenness can be adjusted. Therefore, color unevenness and brightness of the projected images of multiple projectors can be adjusted.

[0119] (Appendix 2) The information processing method described in Appendix 1, further including receiving an input specifying a pair of any one of the plurality of projectors included in the first projector group and any one of the plurality of projectors included in the second projector group, wherein the first projector and the second projector are included in one pair specified by the input. This allows the process of adjusting color unevenness in a projected image to be performed based on the combination of projectors specified by the user.

[0120] (Appendix 3) The information processing method described in Appendix 1 or Appendix 2, further comprising determining at least one of a correction value of the color used by the third projector and a correction value of the color used by the fourth projector based on the color of a third image projected onto the first area by a third projector included in the first projector group and the color of a fourth image projected onto the second area by a fourth projector included in the second projector group, wherein determining at least one of the correction value of the color used by the first projector and the correction value of the color used by the second projector includes determining at least one of the correction value of the color used by the first projector and the correction value of the color used by the second projector without using the color of the third image and the color of the fourth image. This allows the correction values ​​for the first and second projectors to be determined without using the colors of the third and fourth projectors, so the correction values ​​can be determined from less information. This reduces the processing load in the color adjustment process, and allows the colors of the projected image to be adjusted efficiently.

[0121] (Appendix 4) An information processing method described in any one of Appendix 1 to Appendix 3, wherein the first brightness is a sum of the brightness of the first image projected by the first projector onto the first area and the brightness of a third image projected onto the first area by a third projector included in the first projector group, and the second brightness is a sum of the brightness of the second image projected onto the first area by the second projector and the brightness of a fourth image projected onto the second area by a fourth projector included in the second projector group. This makes it possible to use the combined brightness of images projected by multiple projectors to reduce the impact of the darkness of a particular projector and adjust the brightness so that the projected image does not become excessively dark.

[0122] (Appendix 5) The information processing method described in any one of Appendix 1 to Appendix 4, wherein adjusting the brightness of the first projector includes, when the second brightness is darker than the first brightness, darkening the brightness of the first projector based on a ratio between the second brightness and the first brightness. This adjusts the brightness of the first projector based on the ratio of the brightness of the first projector group to the brightness of the second projector group. Therefore, the brightness of each projector can be adjusted by comparing the brightness of the first image group to the brightness of the second image group.

[0123] (Appendix 6) An information processing method described in any one of Appendix 1 to Appendix 5, further comprising: determining, when adjustment of the brightness of the first projector is completed, at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector. According to this method, even if a change in color occurs due to the adjustment of the brightness of the image projected by the projector, there is no need to redo the color adjustment, so that the brightness adjustment and color adjustment can be performed efficiently.

[0124] (Appendix 7) The information processing method described in any one of Supplementary Note 1 to Supplementary Note 6, further including: acquiring the first brightness based on an image acquired by imaging the first area in which the first image group is displayed; acquiring the second brightness based on an image acquired by imaging the second area in which the second image group is displayed; acquiring a color of the first image based on an image acquired by imaging the first area in which the first image is displayed; and acquiring a color of the second image based on an image acquired by imaging the second area in which the second image is displayed. This makes it possible to adjust the brightness by using a captured image of the projection image.

[0125] (Appendix 8) An information processing device including at least one processor, wherein the at least one processor executes the following: determining a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group different from the first projector group, and determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first region by the first projector and a color of a second image projected onto the second region by a second projector included in the second projector group. This reduces the effect of the brightness of one projector in the process of adjusting the brightness of the projected image. Therefore, even if the first projector group or the second projector group includes a projector with low brightness, the adjustment can be performed without significantly impairing the brightness of the projected image. Also, color unevenness can be adjusted by determining at least one of the correction values ​​of the color used by the first projector and the correction values ​​of the color used by the second projector based on the color of the first image and the color of the second image. Therefore, color unevenness and brightness of the projected images of multiple projectors can be adjusted by a method that is less likely to darken the brightness of the projected image.

[0126] (Appendix 9) A program executable by a computer, the program causing the computer to execute the following steps: determine a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first area of ​​a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second area of ​​the projection surface that partially overlaps with the first area by a second projector group different from the first projector group including a plurality of projectors; and determine at least one of a correction value for a color used by the first projector and a correction value for a color used by the second projector based on a color of a first image projected onto the first area by the first projector and a color of a second image projected onto the second area by a second projector included in the second projector group. This reduces the effect of the brightness of one projector in the process of adjusting the brightness of the projected image. Therefore, even if the first projector group or the second projector group includes a projector with low brightness, the adjustment can be performed without significantly impairing the brightness of the projected image. Also, color unevenness can be adjusted by determining at least one of the correction values ​​of the color used by the first projector and the correction values ​​of the color used by the second projector based on the color of the first image and the color of the second image. Therefore, color unevenness and brightness of the projected images of multiple projectors can be adjusted by a method that is less likely to darken the brightness of the projected image. [Explanation of symbols]

[0127] 1...projector, 1A...first projector, 1B...second projector, 1C...third projector, 1D...fourth projector, 2...control device (information processing device), 3A...first image, 3B...second image, 3C...third image, 3D...fourth image, 14...projection unit, 15...camera, 17...first processing unit, 23...second memory unit, 24...second processing unit (processor), 41...first image group, 42...second image group, 101...first projector group, 102...second projector group, 144...light source, 145...liquid crystal light valve, 231...control program, 1000...projection system, A1...first area, A2...second area, P...projected image, SC...projection surface.

Claims

1. determining a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group including a plurality of projectors and different from the first projector group; determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first area by the first projector and a color of a second image projected onto the second area by a second projector included in the second projector group; An information processing method comprising:

2. receiving an input specifying a pair of any one of the plurality of projectors included in the first projector group and any one of the plurality of projectors included in the second projector group; The information processing method according to claim 1 , wherein the first projector and the second projector are included in one pair specified by the input.

3. determining at least one of a correction value of a color used by the third projector and a correction value of a color used by the fourth projector based on a color of a third image projected onto the first area by a third projector included in the first projector group and a color of a fourth image projected onto the second area by a fourth projector included in the second projector group, The information processing method of claim 1 or claim 2, wherein determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector includes determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector without using the color of the third image and the color of the fourth image.

4. the first brightness is a total brightness of the brightness of the first image projected onto the first area by the first projector and the brightness of a third image projected onto the first area by a third projector included in the first projector group, The information processing method of claim 1 or claim 2, wherein the second brightness is a sum of the brightness of the second image projected onto the first area by the second projector and the brightness of a fourth image projected onto the second area by a fourth projector included in the second projector group.

5. 3. The information processing method of claim 1, wherein adjusting the brightness of the first projector includes, when the second brightness is darker than the first brightness, darkening the brightness of the first projector based on a ratio between the second brightness and the first brightness.

6. 3. The information processing method of claim 1, further comprising: determining, when adjustment of the brightness of the first projector is completed, at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector.

7. acquiring the first brightness based on a captured image acquired by capturing an image of the first area in which the first image group is displayed; acquiring the second brightness based on a captured image acquired by capturing an image of the second area in which the second image group is displayed; acquiring a color of the first image based on a captured image acquired by capturing an image of the first area in which the first image is displayed; The information processing method according to claim 1 , further comprising: acquiring a color of the second image based on a captured image acquired by capturing an image of the second area in which the second image is displayed.

8. An information processing device including at least one processor, The at least one processor determining a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group including a plurality of projectors and different from the first projector group; determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first area by the first projector and a color of a second image projected onto the second area by a second projector included in the second projector group; An information processing device that executes the above.

9. A program executable by a computer, The computer includes: determining a brightness of a first projector included in a first projector group based on a first brightness of a first image group projected onto a first region of a projection surface by a first projector group including a plurality of projectors, and a second brightness of a second image group projected onto a second region of the projection surface that partially overlaps with the first region by a second projector group including a plurality of projectors and different from the first projector group; determining at least one of a correction value of a color used by the first projector and a correction value of a color used by the second projector based on a color of a first image projected onto the first area by the first projector and a color of a second image projected onto the second area by a second projector included in the second projector group; A program to execute.

Images