Projection image adjustment method, projection system, processing apparatus, and program

Abstract

To reduce correction by which the difference in brightness between a non-superimposition area and a superimposition area becomes conspicuous.SOLUTION: A projection image adjustment method includes: acquiring a picked-up image obtained by picking up an image of a range including a first area and a second area, in a situation where a first projector projects a first image with uniform luminance in the first area and a second projector projects a second image with uniform luminance in a second area superimposed with a part of the first area; specifying, based on the picked-up image, the brightness a third area where the first area and the second area are superimposed with each other and the brightness of a fourth area in the first area not superimposed with the second area; when the fourth area is darker than the third area, adjusting the first image; and when the fourth area is brighter than the third area, not executing correction to increase the maximum value of the brightness in the fourth area by adjusting the first image.SELECTED DRAWING: Figure 13

Description

[Technical field]

[0001] The present invention relates to a projection image adjustment method, a projection system, a processing device, and a program. [Background technology]

[0002] Patent Document 1 discloses an image projection system that partially overlaps two projected images on a projection surface. In this image projection system, an overlapping area where the two projected images overlap and a non-overlapping area where the two projected images do not overlap are generated on the projection surface. This image projection system performs a correction to increase at least the maximum brightness of the non-overlapping area. By performing this correction, this image projection system reduces the difference between the brightness of the non-overlapping area and the brightness of the overlapping area, and makes the brightness of the overlapping area and the brightness of the non-overlapping area uniform. The technology disclosed in Patent Document 1 is effective when the brightness of the non-overlapping area before correction is darker than the brightness of the overlapping area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-137386 A Summary of the Invention [Problem to be solved by the invention]

[0004] Depending on the shape of the projection surface, the brightness of the non-overlapping area before correction may be brighter than the brightness of the overlapping area. When the correction disclosed in Patent Document 1 is performed in a situation where the brightness of the non-overlapping area before correction is brighter than the brightness of the overlapping area, at least the maximum value of the luminance of the non-overlapping area is increased, and there is a risk that the difference between the brightness of the non-overlapping area and the brightness of the overlapping area becomes noticeable. For this reason, a technology is desired that can suppress the correction that makes the difference between the brightness of the non-overlapping area and the brightness of the overlapping area more noticeable when the brightness of the non-overlapping area is brighter than the brightness of the overlapping area. [Means for solving the problem]

[0005] One embodiment of a method for adjusting a projection image according to the present invention includes, in a situation where a first projector projects a first image having uniform brightness toward a first region of a projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion that overlaps with a portion of the first region, acquiring a captured image obtained by capturing an image of a range including the first region and the second region, determining, based on the captured image, the brightness of a third region where the first region and the second region overlap, and the brightness of a fourth region of the first region that does not overlap with the second region, adjusting the first image if the brightness of the fourth region is darker than the brightness of the third region, and not performing a correction to increase the maximum brightness in the fourth region by adjusting the first image if the brightness of the fourth region is brighter than the brightness of the third region.

[0006] One embodiment of a projection system according to the present invention includes a first projector that projects a first image having uniform brightness toward a first region of a projection surface; a second projector that projects a second image having uniform brightness toward a second region of the projection surface having a portion that overlaps with a part of the first region; a camera that generates a captured image by capturing an image of an area including the first region and the second region when the first image is projected toward the first region and the second image is projected toward the second region; and a processing device that performs the following operations: acquires the captured image; determines, based on the captured image, the brightness of a third region where the first region and the second region overlap and the brightness of a fourth region of the first region that does not overlap with the second region; and adjusts the first image if the brightness of the fourth region is darker than the brightness of the third region; and does not perform a correction to increase the maximum brightness in the fourth region by adjusting the first image if the brightness of the fourth region is brighter than the brightness of the third region.

[0007] One embodiment of the processing device of the present invention performs the following operations in a situation where a first projector projects a first image having uniform brightness toward a first region of a projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion that overlaps with the first region: obtains a captured image obtained by capturing an area including the first region and the second region; determines, based on the captured image, the brightness of a third region where the first region and the second region overlap, and the brightness of a fourth region of the first region that does not overlap with the second region; and, if the brightness of the fourth region is darker than the brightness of the third region, adjusts the first image; and, if the brightness of the fourth region is brighter than the brightness of the third region, does not perform a correction to increase the maximum brightness in the fourth region by adjusting the first image.

[0008] One aspect of the program of the present invention causes a computer to: obtain a captured image obtained by capturing an area including a first area and a second area in a situation where a first projector projects a first image having uniform brightness toward a first area of ​​a projection surface, and a second projector projects a second image having uniform brightness toward a second area of ​​the projection surface having a portion that overlaps with a part of the first area; determine, based on the captured image, the brightness of a third area where the first area and the second area overlap, and the brightness of a fourth area of ​​the first area that does not overlap with the second area; and adjust the first image if the brightness of the fourth area is darker than the brightness of the third area; and do not perform a correction to increase the maximum brightness in the fourth area by adjusting the first image if the brightness of the fourth area is brighter than the brightness of the third area. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic diagram of a projection system 1 according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a first image A1. [Diagram 3] FIG. 13 is a diagram showing an example of a second image A2. [Figure 4] 2 is a plan view of the projection surface S. FIG. [Diagram 5] 4 is a diagram showing an example of the illuminance of a projection surface S. FIG. [Figure 6] 13 is a diagram showing another example of the illuminance of the projection surface S. FIG. [Figure 7] 13 is a diagram showing still another example of the illuminance of the projection surface S. FIG. [Figure 8] FIG. 11 is a diagram for explaining an example of a first correction. [Figure 9] FIG. 2 is a diagram illustrating an example of a first projector 10. [Figure 10] FIG. 2 is a diagram illustrating an example of a second projector 20. [Figure 11] FIG. 2 is a diagram illustrating an example of a camera 30. [Figure 12] FIG. 4 illustrates an example of an information processing device 40. [Figure 13] 2 is a diagram for explaining the operation of the projection system 1. FIG. [Figure 14] 1 is a diagram showing a first region S1, a second region S2, an overlapping region S3, a first non-overlapping region S4, and a second non-overlapping region S5. [Figure 15] FIG. 11 is a diagram for explaining an example of a third correction. [Figure 16] 13 is a diagram showing an example of a first image A1 after adjustment in a third correction. FIG. [Figure 17] FIG. 13 is a diagram showing an example of a second image A2 after adjustment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] A: First embodiment A1: Overview of Projection System 1 1 is a schematic diagram of a projection system 1 according to a first embodiment. The projection system 1 projects an image onto a projection surface S.

[0011] The projection surface S is a convex curved surface. The projection surface S is not limited to a convex curved surface. For example, the projection surface S may be a flat surface or a concave curved surface. The projection surface S has a first region S1 and a second region S2. The second region S2 has a portion that overlaps with a part of the first region S1.

[0012] The projection system 1 includes a first projector 10, a second projector 20, a camera 30, and an information processing device 40. The camera 30 may be included in any one of the information processing device 40, the first projector 10, or the second projector 20.

[0013] The first projector 10, the second projector 20, and the camera 30 are connected to the information processing device 40 by wires. The first projector 10, the second projector 20, and the camera 30 may be connected to the information processing device 40 wirelessly.

[0014] The first projector 10 projects a first image A1 toward the first region S1. The first image A1 is an image having uniform luminance.

[0015] The second projector 20 projects the second image A2 toward the second region S2. The second image A2 is an image having uniform luminance.

[0016] The camera 30 generates an image by capturing an image of a range including the first region S1 and the second region S2 in a situation where the first image A1 is projected toward the first region S1 and the second image A2 is projected toward the second region S2.

[0017] The information processing device 40 controls the first projector 10 based on the captured image. The information processing device 40 may control the first projector 10 and the second projector 20 based on the captured image.

[0018] 2 is a diagram showing an example of a first image A1 projected from the first projector 10 toward the first region S1. The first image A1 is a monochrome black image. The first image A1 is not limited to a monochrome black image. The first image A1 may be, for example, a monochrome black-gray image or a monochrome gray image.

[0019] The first image A1 includes a first image for superimposition A1a and a first image for non-superimposition A1b. The first image for superimposition A1a is an image that is superimposed on a part of the second image A2 projected from the second projector 20. The first image for non-superimposition A1b is an image that is not superimposed on the second image A2 projected from the second projector 20.

[0020] FIG. 3 is a diagram showing an example of the second image A2 projected from the second projector 20 toward the second region S2. The second image A2 is a monochromatic black image similar to the first image A1. The second image A2 is not limited to a monochromatic black image. For example, when the first image A1 is a monochromatic black-gray image, the second image A2 may be a monochromatic black-gray image similar to the first image A1. When the first image A1 is a monochromatic gray image, the second image A2 may be a monochromatic gray image similar to the first image A1.

[0021] The second image A2 includes a second superimposition image A2a and a second non-superimposition image A2b. The second superimposition image A2a is an image that is superimposed on the first superimposition image A1a projected from the first projector 10. The second non-superimposition image A2b is an image that is not superimposed on the first image A1.

[0022] 4 is a plan view of a projection surface S having a first region S1 and a second region S2. The first region S1 is indicated by a solid line. The second region S2 is indicated by a dashed line. In the plan view of the projection surface S shown in FIG. 4, for convenience of explanation, the first region S1 and the second region S2 are indicated as rectangles. In the plan view of the projection surface S, the first region S1 and the second region S2 may have shapes other than a rectangle.

[0023] In the following description, mutually orthogonal X-axis and Y-axis are used. The X-axis is, for example, parallel to the horizontal direction. The Y-axis is, for example, parallel to the vertical direction.

[0024] The second region S2 is located at a position offset in the X-axis direction from the first region S1. The second region S2 may be located at a position offset in the opposite direction to the X-axis direction from the first region S1. In this case, the positional relationship between the first superimposition image A1a and the first non-superimposition image A1b in the first image A1 is reversed, and the positional relationship between the second superimposition image A2a and the second non-superimposition image A2b in the second image A2 is reversed. The position of the second region S2 in the Y-axis direction is the same as the position of the first region S1 in the Y-axis direction.

[0025] The first region S1 includes an overlapping region S3 and a first non-overlapping region S4.

[0026] The overlapping area S3 is an area where the first area S1 and the second area S2 overlap. The overlapping area S3 is an example of a part of the first area S1. The overlapping area S3 is also an example of a third area. A first overlapping image A1a in the first image A1 and a second overlapping image A2a in the second image A2 are projected onto the overlapping area S3.

[0027] The first non-overlapping region S4 is a region of the first region S1 that does not overlap with the second region S2. The first non-overlapping region S4 is an example of a fourth region. A first non-overlapping image A1b in the first image A1 is projected onto the first non-overlapping region S4.

[0028] The second region S2 includes an overlap region S3 and a second non-overlapping region S5. The second non-overlapping region S5 is a region of the second region S2 that does not overlap with the first region S1. A second non-overlapping image A2b in the second image A2 is projected onto the second non-overlapping region S5.

[0029] FIG. 4 further shows end portions S1a and S1b of the first region S1, a central portion S1c of the first region S1, end portions S2a and S2b of the second region S2, and a central portion S2c of the second region S2.

[0030] The end S1a of the first region S1 is the end of the first region S1 in the X-axis direction. The end S1b of the first region S1 is the end of the first region S1 in the direction opposite to the X-axis direction. The central portion S1c of the first region S1 is the center of the first region S1 in the X-axis direction. The end S2a of the second region S2 is the end of the second region S2 in the direction opposite to the X-axis direction. The end S2b of the second region S2 is the end of the second region S2 in the X-axis direction. The central portion S2c of the second region S2 is the center of the second region S2 in the X-axis direction.

[0031] Projectors such as the first projector 10 and the second projector 20 tend to project a monochromatic black image containing little light as a monochromatic black image. Moreover, projectors such as the first projector 10 and the second projector 20 tend to project an image containing little light as an image such as a monochromatic black image, a monochromatic black-gray, and a monochromatic gray image.

[0032] The first projector 10 projects the first image A1, which is a monochromatic black image, toward the first region S1. The second projector 20 projects the second image A2, which is a monochromatic black image, toward the second region S2. Therefore, the overlap region S3 is illuminated by both the light contained in the first image A1 and the light contained in the second image A2. The first non-overlapping region S4 is illuminated by the light contained in the first image A1, but not by the light contained in the second image A2. The second non-overlapping region S5 is illuminated by the light contained in the second image A2, but not by the light contained in the first image A1.

[0033] Fig. 5 is a diagram showing an example of the illuminance E of the projection surface S. In Fig. 5, the projection surface S is flat. When the projection surface S is flat, the illuminance of the overlapping region S3 is higher than the illuminance of the first non-overlapping region S4. Therefore, the first non-overlapping region S4 becomes darker than the overlapping region S3.

[0034] 6 is a diagram showing another example of the illuminance E of the projection surface S. In FIG. 6, the projection surface S is the convex curved surface shown in FIG.

[0035] When the second image A2 is not projected and the first image A1 is projected toward the first region S1, which is a convex curved surface, the ends S1a and S1b of the first region S1 become darker than the central portion S1c of the first region S1. Also, the greater the curvature of the first region S1, the darker the ends S1a and S1b of the first region S1 become than the central portion S1c of the first region S1.

[0036] When the first image A1 is not projected and the second image A2 is projected toward the second region S2, which is a convex curved surface, the ends S2a and S2b of the second region S2 become darker than the central portion S2c of the second region S2. Also, the greater the curvature of the second region S2, the darker the ends S2a and S2b of the second region S2 become than the central portion S2c of the second region S2.

[0037] Therefore, depending on the shape of the projection surface S, contrary to the example shown in FIG. 5, the first non-overlapping region S4 may end up being brighter than the overlapping region S3, as shown in FIG.

[0038] In the example shown in FIG. 6, the illuminance is zero at ends S1a and S1b of the first region S1 and at ends S2a and S2b of the second region S2.

[0039] Fig. 7 is a diagram showing another example of the illuminance of the projection surface S. In Fig. 7, the projection surface S is a convex curved surface having a curvature different from the curvature of the convex curved surface shown in Fig. 1. In the example shown in Fig. 7, the illuminance is greater than zero at the ends S1a and S1b of the first region S1 and the ends S2a and S2b of the second region S2.

[0040] Also in the example shown in FIG. 7, the first non-overlapping region S4 is brighter than the overlapping region S3.

[0041] In addition, in the example shown in FIG. 7, the illuminance is greater than zero at the ends S1a and S1b of the first region S1 and the ends S2a and S2b of the second region S2, so that a step in illuminance occurs at the boundary between the first non-overlapping region S4 and the overlapping region S3 and the boundary between the overlapping region S3 and the second non-overlapping region S5.

[0042] 1 shows the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4. The information processing device 40 acquires the captured image. The information processing device 40 identifies the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4 based on the captured image.

[0043] As shown in FIG. 5, when the brightness of the first non-overlapping area S4 is darker than the brightness of the overlapping area S3, the information processing device 40 controls the first projector 10 to adjust the first image A1.

[0044] As an example, when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, the information processing device 40 executes a first correction. The first correction is a correction for increasing the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1. The first correction is, for example, a correction for maintaining the brightness of the first superimposition image A1a included in the first image A1 and increasing the brightness of the first non-overlapping image A1b included in the first image A1.

[0045] Fig. 8 is a diagram for explaining an example of the first correction. In Fig. 8, in addition to the brightness of the first non-overlapping region S4, the brightness of the second non-overlapping region S5 is also corrected in the same manner as the brightness of the first non-overlapping region S4.

[0046] 8, the illuminance e2 of the first non-overlapping region S4 after the first correction is higher than the illuminance e1 of the first non-overlapping region S4 before the first correction. Similarly, the illuminance e4 of the second non-overlapping region S5 after the first correction is higher than the illuminance e3 of the second non-overlapping region S5 before the first correction.

[0047] On the other hand, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3 as shown in FIGS. 6 and 7, the information processing device 40 does not perform the first correction.

[0048] For example, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the information processing device 40 maintains the first image A1 without performing correction to adjust the first image A1.

[0049] A2: 1st projector 10 9 is a diagram showing an example of the first projector 10. The first projector 10 includes a first image processing device 110, a first light source 120, a first light modulation device 130, and a first projection optical system 140.

[0050] The first image processing device 110 is configured with a circuit such as an image processing circuit. The first image processing device 110 receives image data b1 from the information processing device 40. The first image processing device 110 generates an image signal c1 by performing image processing such as gamma correction on the image data b1. The image signal c1 is a signal based on the image data b1. For example, when the image data b1 indicates a monochrome black image, the image signal c1 also indicates a monochrome black image.

[0051] The first light source 120 is a light emitting diode (LED). The first light source 120 is not limited to an LED, and may be, for example, a xenon lamp or a laser light source. The first light source 120 emits light L1 toward the first light modulation device .

[0052] The first light modulation device 130 generates an image by modulating the light L1 based on the image signal c1. The first light modulation device 130 includes, for example, a liquid crystal light valve. The first light modulation device 130 changes the light transmittance of the liquid crystal light valve based on the image signal c1. The first light modulation device 130 generates an image by modulating the light L1 using the liquid crystal light valve whose light transmittance is changed. The first projector 10 may be configured to include a DMD (Digital Micromirror Device) instead of the first light modulation device 130.

[0053] When the image signal c1 indicates a monochrome black image, a part of the light L1 passes through the first light modulation device 130. Therefore, when the image signal c1 indicates a monochrome black image, the first light modulation device 130 generates a monochrome black image containing a small amount of light. In other words, when the image signal c1 indicates a monochrome black image, the first light modulation device 130 generates the first image A1, which is a monochrome black image containing a small amount of light.

[0054] The light modulation element that modulates the light L1 in the first light modulation device 130 is not limited to a liquid crystal light valve and can be changed as appropriate. Note that, when the light modulation element is configured to transmit a part of the light L1 when the image signal c1 indicates a monochrome black image, like a liquid crystal light valve, not executing the first correction is particularly effective.

[0055] The first projection optical system 140 includes one or more lenses. When the image signal c1 indicates a monochrome black image, the first projection optical system 140 projects the first image A1 toward the first region S1.

[0056] A3: 2nd projector 20 10 is a diagram showing an example of the second projector 20. The second projector 20 includes a second image processing device 210, a second light source 220, a second light modulation device 230, and a second projection optical system 240.

[0057] The second image processing device 210 is configured by, for example, a circuit such as an image processing circuit. The second image processing device 210 receives image data b2 from the information processing device 40. The second image processing device 210 generates an image signal c2 by performing image processing such as gamma correction on the image data b2. The image signal c2 is a signal based on the image data b2. For example, when the image data b2 indicates a monochrome black image, the image signal c2 also indicates a monochrome black image.

[0058] The second light source 220 is an LED. The second light source 220 is not limited to an LED, and may be, for example, a xenon lamp or a laser light source. The second light source 220 emits light L2 toward the second light modulation device 230.

[0059] The second light modulation device 230 generates an image by modulating the light L2 based on the image signal c2. The second light modulation device 230 includes, for example, a liquid crystal light valve. The second light modulation device 230 changes the light transmittance of the liquid crystal light valve based on the image signal c2. The second light modulation device 230 generates an image by modulating the light L2 using the liquid crystal light valve whose light transmittance is changed. The second projector 20 may be configured to include a DMD instead of the second light modulation device 230.

[0060] When the image signal c2 indicates a monochrome black image, a part of the light L2 passes through the second light modulation device 230. Therefore, when the image signal c2 indicates a monochrome black image, the second light modulation device 230 generates a monochrome black image containing a small amount of light. In other words, when the image signal c2 indicates a monochrome black image, the second light modulation device 230 generates a second image A2 that is a monochrome black image containing a small amount of light.

[0061] The light modulation element that modulates the light L2 in the second light modulation device 230 is not limited to a liquid crystal light valve and can be changed as appropriate. Note that, when the light modulation element is configured to transmit a part of the light L2 when the image signal c2 indicates a monochrome black image, like a liquid crystal light valve, it is particularly effective not to execute the second correction described below.

[0062] The second projection optical system 240 includes one or more lenses. When the image signal c2 indicates a monochrome black image, the second projection optical system 240 projects the second image A2 toward the second region S2.

[0063] A4: Camera 30 11 is a diagram showing an example of a camera 30. The camera 30 includes an imaging optical system 310, an image sensor 320, and an imaging execution unit 330.

[0064] The imaging optical system 310 includes one or more lenses. The imaging optical system 310 forms an optical image of a range including the first region S1 and the second region S2 on the image sensor 320.

[0065] The image sensor 320 is a CCD (Charge Coupled Device) image sensor. The image sensor 320 is not limited to a CCD image sensor. The image sensor 320 may be, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The image sensor 320 generates imaging data d1 based on an optical image formed by the imaging optical system 310 in a situation where the first image A1 is projected toward the first region S1 and the second image A2 is projected toward the second region S2. The imaging data d1 indicates a captured image. The captured image indicates the first region S1 and the second region S2. The camera 30 generates the imaging data d1 means that the camera 30 generates a captured image.

[0066] The imaging execution unit 330 controls imaging by controlling the image sensor 320. The imaging execution unit 330 provides imaging data d1 generated by the image sensor 320 to the information processing device 40. The imaging execution unit 330 includes one or more CPUs (Central Processing Units).

[0067] A5: Information processing device 40 FIG. 12 is a diagram showing an example of an information processing device 40. The information processing device 40 is a PC (Personal Computer). The information processing device 40 is not limited to a PC. The information processing device 40 may be, for example, a tablet, a smartphone, or a dedicated processing device. Each of the PC, the tablet, and the smartphone is an example of a general-purpose processing device. The information processing device 40 is an example of a processing device.

[0068] The information processing device 40 includes an operation device 410 , a display device 420 , a storage device 430 , and a processing device 440 .

[0069] The operation device 410 includes, for example, a keyboard, a mouse, an operation button, an operation key, or a touch panel. The operation device 410 receives input operations from the user.

[0070] The display device 420 includes a display. The display is, for example, a flat panel display (FPD) such as a liquid crystal display, a plasma display, or an organic electroluminescence (EL) display. The display device 420 displays various information. The display device 420 may be omitted.

[0071] The storage device 430 is a recording medium that can be read by a computer. The storage device 430 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), and an Electrically Erasable Programmable Read Only Memory (EEPROM). The volatile memory is, for example, a Random Access Memory (RAM).

[0072] The storage device 430 stores a program P1. The program P1 determines the operation of the processing device 440. The storage device 430 may store the program P1 that is read from a storage device in a server (not shown). In this case, the storage device in the server is an example of a computer-readable recording medium.

[0073] The processing device 440 includes one or more CPUs. The one or more CPUs are examples of one or more processors. Each of the processing device 440, the processor, the CPU, and the information processing device 40 is an example of a computer. The processing device 440 is another example of a processing device.

[0074] The processing device 440 reads the program P1 from the storage device 430. The processing device 440 functions as an acquisition unit 441, a specification unit 442, and a correction unit 443 by executing the program P1.

[0075] At least one of the acquisition unit 441, the determination unit 442, and the correction unit 443 may be configured by a circuit such as a DSP (Digital Signal Processor) and an ASIC (Application Specific Integrated Circuit). At least one of the acquisition unit 441, the determination unit 442, and the correction unit 443 means "acquisition unit 441", "determination unit 442", "correction unit 443", "acquisition unit 441 and determination unit 442", "acquisition unit 441 and correction unit 443", "determination unit 442 and correction unit 443", or "acquisition unit 441, determination unit 442, and correction unit 443".

[0076] The acquisition unit 441 acquires a captured image. For example, the acquisition unit 441 acquires the captured image by acquiring imaging data d1. The acquisition unit 441 acquires the imaging data d1 directly from the camera 30. The acquisition unit 441 may acquire the imaging data d1 indirectly from the camera 30. For example, when the camera 30 is included in the first projector 10, the acquisition unit 441 may acquire the imaging data d1 from the camera 30 via the first projector 10.

[0077] The determination unit 442 determines the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4 based on the captured image represented by the imaging data d1.

[0078] The brightness of the overlapping region S3 is the average value of the brightness in the overlapping region S3. The brightness of the overlapping region S3 is not limited to the average value of the brightness in the overlapping region S3. The brightness of the overlapping region S3 may be, for example, the maximum value of the brightness in the overlapping region S3.

[0079] The brightness of the first non-overlapping region S4 is the average value of the brightness in the first non-overlapping region S4. The brightness of the first non-overlapping region S4 is not limited to the average value of the brightness in the first non-overlapping region S4. For example, if the brightness of the overlapping region S3 is the maximum value of the brightness in the overlapping region S3, the brightness of the first non-overlapping region S4 may be the maximum value of the brightness in the first non-overlapping region S4.

[0080] The determination unit 442 may further determine the brightness of the second non-overlapping region S5 based on the captured image represented by the imaging data d1.

[0081] The brightness of the second non-overlapping region S5 is the average value of the brightness in the second non-overlapping region S5. The brightness of the second non-overlapping region S5 is not limited to the average value of the brightness in the second non-overlapping region S5. For example, when the brightness of the overlapping region S3 is the maximum value of the brightness in the overlapping region S3, the brightness of the second non-overlapping region S5 may be the maximum value of the brightness in the second non-overlapping region S5.

[0082] The correction section 443 controls the first projector 10 based on the captured image. The correction section 443 may control the first projector 10 and the second projector 20 based on the captured image.

[0083] As shown in FIG. 5, when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, the corrector 443 executes correction to adjust the first image A1.

[0084] For example, when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, the correction unit 443 executes the first correction. As described above, the first correction is a correction that increases the maximum brightness value in the first non-overlapping region S4 by adjusting the first image A1.

[0085] The maximum brightness value in the first non-overlapping region S4 is, for example, the maximum luminance value in the first non-overlapping region S4.

[0086] The correction unit 443 adjusts the first image A1 by adjusting the image data b1. Therefore, the correction unit 443 executes the first correction by adjusting the image data b1.

[0087] Hereinafter, adjusting the first image A1 means adjusting the first image A1 by adjusting the image data b1.

[0088] 6 or 7, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the correction unit 443 does not execute the first correction. In other words, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the correction unit 443 does not execute the correction for increasing the maximum brightness value in the first non-overlapping region S4 by adjusting the first image A1.

[0089] For example, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the correction unit 443 maintains the first image A1 without performing correction to adjust the image data b1.

[0090] Furthermore, as shown in FIG. 5, when the brightness of the second non-overlapping region S5 is darker than the brightness of the overlapping region S3, the corrector 443 may perform correction to adjust the second image A2.

[0091] For example, when the brightness of the second non-overlapping region S5 is darker than the brightness of the overlapping region S3, the correction unit 443 executes the second correction. The second correction is a correction for increasing the maximum brightness value in the second non-overlapping region S5 by adjusting the second image A2.

[0092] The correction unit 443 adjusts the second image A2 by adjusting the image data b2. Therefore, the correction unit 443 executes the second correction by adjusting the image data b2.

[0093] Hereinafter, adjusting the second image A2 means adjusting the second image A2 by adjusting the image data b2.

[0094] 6 or 7, when the brightness of the second non-overlapping region S5 is brighter than the brightness of the overlapping region S3, the correction unit 443 does not execute the second correction. In other words, when the brightness of the second non-overlapping region S5 is brighter than the brightness of the overlapping region S3, the correction unit 443 does not execute the correction for increasing the maximum brightness value in the second non-overlapping region S5 by adjusting the second image A2.

[0095] For example, when the brightness of the second non-overlapping region S5 is brighter than the brightness of the overlapping region S3, the correction section 443 maintains the second image A2 without adjusting the image data b2.

[0096] A6: Description of operation FIG. 13 is a diagram for explaining the operation of the projection system 1. As shown in FIG.

[0097] In step S101, the first projector 10 projects a first image A1 toward the first region S1, and the second projector 20 projects a second image A2 toward the second region S2.

[0098] In step S101, first, when the operation device 410 of the information processing device 40 receives an operation instruction from a user, it provides the operation instruction to the processing device 440. In response to the operation instruction, the correction unit 443 of the processing device 440 provides the first projector 10 with image data b1 indicating a monochrome black image, and provides the second projector 20 with image data b2 indicating a monochrome black image. The first projector 10 projects the first image A1 toward the first region S1 based on the image data b1 indicating the monochrome black image. The second projector 20 projects the second image A2 toward the second region S2 based on the image data b2 indicating the monochrome black image.

[0099] Next, in step S102, the camera 30 captures an image of an area including the first region S1 and the second region S2 in a situation where the first image A1 is projected toward the first region S1 and the second image A2 is projected toward the second region S2.

[0100] In step S102, the correction unit 443 provides an imaging instruction to the camera 30 in a situation where the first image A1 is projected toward the first region S1 in response to the provision of image data b1, and the second image A2 is projected toward the second region S2 in response to the provision of image data b2. The camera 30 generates imaging data d1 by imaging an area including the first region S1 and the second region S2 in response to the imaging instruction. The camera 30 provides the imaging data d1 to the information processing device 40. The imaging data d1 indicates a captured image, as described above.

[0101] Next, in step S103, the acquisition unit 441 acquires a captured image. In step S103, the acquisition unit 441 acquires imaging data d1 from the camera 30, thereby acquiring the captured image.

[0102] Next, in step S104, the specification unit 442 specifies the brightness of the overlap region S3, the brightness of the first non-overlap region S4, and the brightness of the second non-overlap region S5 based on the captured image.

[0103] In step S104, the determination unit 442 determines the average luminance value in the overlap region S3 as the brightness of the overlap region S3 based on the captured image. The determination unit 442 determines the average luminance value in the first non-overlap region S4 as the brightness of the first non-overlap region S4 based on the captured image. The determination unit 442 determines the average luminance value in the second non-overlap region S5 as the brightness of the second non-overlap region S5 based on the captured image.

[0104] The position of the overlapping region S3 in the captured image, the position of the first non-overlapping region S4 in the captured image, and the position of the second non-overlapping region S5 in the captured image are specified in advance.

[0105] For example, first, in a situation where the second projector 20 does not project an image and the first projector 10 projects a monochrome white image onto the first region S1, the camera 30 captures an image of an area including the first region S1 and the second region S2 to generate first captured data. The first captured data represents the first captured image.

[0106] Next, in a situation where the first projector 10 does not project an image and the second projector 20 projects a monochrome white image onto the second region S2, the camera 30 captures an image of an area including the first region S1 and the second region S2 to generate second captured data. The second captured data represents a second captured image.

[0107] Next, the acquisition section 441 acquires the first captured image and the second captured image by acquiring the first captured data and the second captured data.

[0108] The determination unit 442 superimposes the first captured image and the second captured image, and determines the position of an area in which a white image exists in the first captured image, where the white image also exists in the second captured image, as the position of an overlapping area S3 in the captured image. The determination unit 442 determines the position of an area in which a white image exists in the first captured image, which is different from the overlapping area S3 in the captured image, as the position of a first non-overlapping area S4 in the captured image. The determination unit 442 determines the position of an area in which a white image exists in the second captured image, which is different from the overlapping area S3 in the captured image, as the position of a second non-overlapping area S5 in the captured image.

[0109] The method of identifying the position of the overlapping region S3 in the captured image, the position of the first non-overlapping region S4 in the captured image, and the position of the second non-overlapping region S5 in the captured image is not limited to the above-mentioned method. For example, a monochrome yellow image or a monochrome red image may be used instead of the monochrome white image.

[0110] The identification unit 442 may also identify the position of the overlapping region S3 in the captured image, the position of the first non-overlapping region S4 in the captured image, and the position of the second non-overlapping region S5 in the captured image using the first projective transformation matrix and the second projective transformation matrix. The first projective transformation matrix is ​​a projective transformation matrix that indicates the correspondence between the positions of points in the first image A1 and the positions of points in the captured image. The second projective transformation matrix is ​​a projective transformation matrix that indicates the correspondence between the positions of points in the second image A2 and the positions of points in the captured image. In this case, the identification unit 442 may identify the position of the overlapping region S3 in the captured image using the position of the first image A1a for superimposition in the first image A1 and the first projective transformation matrix. The identification unit 442 may identify the position of the overlapping region S3 in the captured image using the position of the second image A2a for superimposition in the second image A2 and the second projective transformation matrix. The determination unit 442 determines the position of the first non-overlap region S4 in the captured image using the position of the first non-overlap image A1b in the first image A1 and the first projective transformation matrix. The determination unit 442 determines the position of the second non-overlap region S5 in the captured image using the position of the second non-overlap image A2b in the second image A2 and the second projective transformation matrix.

[0111] Next, in step S105, the correction unit 443 determines whether the brightness of the first non-overlapping area S4 is darker than the brightness of the overlapping area S3.

[0112] When the correction unit 443 determines in step S105 that the brightness of the first non-overlapping area S4 is darker than the brightness of the overlapping area S3 (step S105 / YES), the correction unit 443 advances the process to step S106.

[0113] In step S106, the correction unit 443 executes a first correction. The first correction is a correction for increasing the maximum brightness value in the first non-overlapping region S4 by adjusting the first image A1. By the first correction, the first image A1 is adjusted so that the brightness of the first non-overlapping region S4 approaches the brightness of the overlapping region S3.

[0114] The correction unit 443 performs the first correction as shown in FIG. 8, for example, by adjusting the image data b1 so that the luminance of the first non-overlap image A1b shown in FIG. 2 is uniformly increased by the first adjustment value.

[0115] The first adjustment value is, for example, a fixed value set in advance. The first adjustment value is not limited to a fixed value set in advance. The first adjustment value may be, for example, a value based on a difference between the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4. For example, the correction unit 443 increases the first adjustment value as the difference between the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4 increases, and the correction unit 443 decreases the first adjustment value as the difference between the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4 decreases.

[0116] On the other hand, if the correction unit 443 determines in step S105 that the brightness of the first non-overlap region S4 is not darker than the brightness of the overlap region S3 (step S105 / NO), the process proceeds to step S107. For example, if the correction unit 443 determines that the brightness of the first non-overlap region S4 is brighter than the brightness of the overlap region S3, the process proceeds to step S107. If the correction unit 443 determines that the brightness of the first non-overlap region S4 is equal to the brightness of the overlap region S3, the process proceeds to step S107.

[0117] In step S107, the correction unit 443 does not execute the first correction. For example, the correction unit 443 maintains the first image A1 without executing the correction for adjusting the image data b1.

[0118] Following step S106 or step S107, in step S108, the correction unit 443 determines whether the brightness of the second non-overlapping area S5 is darker than the brightness of the overlapping area S3.

[0119] When the correction unit 443 determines in step S108 that the brightness of the second non-overlapping area S5 is darker than the brightness of the overlapping area S3 (step S108 / YES), the correction unit 443 advances the process to step S109.

[0120] In step S109, the correction unit 443 executes a second correction. The second correction is a correction for increasing the maximum brightness value in the second non-overlapping region S5 by adjusting the second image A2. By the second correction, the second image A2 is adjusted so that the brightness of the second non-overlapping region S5 approaches the brightness of the overlapping region S3.

[0121] The correction unit 443 performs the second correction as shown in FIG. 8, for example, by adjusting the image data b2 so that the luminance of the second non-superimposition image A2b shown in FIG. 3 is uniformly increased by the second adjustment value.

[0122] The second adjustment value is, for example, a fixed value set in advance. The second adjustment value is not limited to a fixed value set in advance. The second adjustment value may be, for example, a value based on a difference between the brightness of the overlapping region S3 and the brightness of the second non-overlapping region S5. For example, the correction unit 443 increases the second adjustment value as the difference between the brightness of the overlapping region S3 and the brightness of the second non-overlapping region S5 increases, and the correction unit 443 decreases the second adjustment value as the difference between the brightness of the overlapping region S3 and the brightness of the second non-overlapping region S5 decreases.

[0123] On the other hand, if the correction unit 443 determines in step S108 that the brightness of the second non-overlap region S5 is not darker than the brightness of the overlap region S3 (step S108 / NO), the process proceeds to step S110. For example, if the correction unit 443 determines that the brightness of the second non-overlap region S5 is brighter than the brightness of the overlap region S3, the process proceeds to step S110. On the other hand, if the correction unit 443 determines that the brightness of the second non-overlap region S5 is equal to the brightness of the overlap region S3, the process proceeds to step S110.

[0124] In step S110, the correction unit 443 does not execute the second correction. For example, the correction unit 443 maintains the second image A2 without adjusting the image data b2.

[0125] Note that steps S108 to S110 may be executed before step S105. Also, steps S108 to S110 may be omitted.

[0126] A7: Summary of the first embodiment The first embodiment includes the following aspects.

[0127] The method for adjusting a projection image according to the first embodiment includes the steps of: acquiring a captured image obtained by capturing an image of a range including the first region S1 and the second region S2 in a situation in which a first projector 10 projects a first image A1 having uniform brightness toward a first region S1 of a projection surface S, and a second projector 20 projects a second image A2 having uniform brightness toward a second region S2 of the projection surface S that has a portion overlapping with a part of the first region S1; and calculating a captured image of the first region S1 and the second region S2 based on the captured image. the brightness of an overlap region S3 where the first region S1 and the second region S2 overlap, and the brightness of a first non-overlapping region S4 of the first region S1 that does not overlap with the second region S2; performing a correction to adjust the first image A1 when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3; and not performing a correction to increase the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1 when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3.

[0128] The projection system 1 includes a first projector 10 that projects a first image A1 having uniform luminance toward a first region S1 of a projection surface S, a second projector 20 that projects a second image A2 having uniform luminance toward a second region S2 of the projection surface S that has a portion overlapping with a part of the first region S1, a camera 30 that generates a captured image by capturing an image of a range including the first region S1 and the second region S2 in a situation where the first image A1 is projected toward the first region S1 and the second image A2 is projected toward the second region S2, and an information processing device 40. The information processing device 40 acquires an image, determines based on the image the brightness of an overlap region S3 where the first region S1 and the second region S2 overlap, and the brightness of a first non-overlapping region S4 of the first region S1 that does not overlap with the second region S2, and adjusts the first image A1 if the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, and does not perform a correction to increase the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1 if the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3.

[0129] The information processing device 40 acquires a captured image obtained by capturing an image of a range including the first region S1 and the second region S2 in a situation in which the first projector 10 projects a first image A1 having uniform brightness toward the first region S1 of the projection surface S and the second projector 20 projects a second image A2 having uniform brightness toward the second region S2 of the projection surface S having a portion overlapping with the first region S1, and acquires a captured image obtained by capturing an image of a range including the first region S1 and the second region S2 in a situation in which the first projector 10 projects a first image A1 having uniform brightness toward the first region S1 of the projection surface S and the second image A2 having uniform brightness toward the second region S2 of the projection surface S, The brightness of an overlap region S3 where the first region S1 and the second region S2 overlap and the brightness of a first non-overlapping region S4 of the first region S1 that does not overlap with the second region S2 are identified, and if the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, the first image A1 is adjusted, and if the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, a correction for increasing the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1 is not performed.

[0130] The program P1 causes the processing device 440 to acquire a captured image obtained by capturing an image of a range including the first region S1 and the second region S2 in a situation in which the first projector 10 projects a first image A1 having uniform brightness toward the first region S1 of the projection surface S and the second projector 20 projects a second image A2 having uniform brightness toward the second region S2 of the projection surface S having a portion overlapping with the first region S1, and The brightness control unit 100 determines the brightness of an overlap region S3 where the first region S1 and the second region S2 overlap, and the brightness of a first non-overlapping region S4 of the first region S1 that does not overlap with the second region S2, and adjusts the first image A1 if the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, and does not perform a correction for increasing the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1 if the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3.

[0131] For example, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, if a correction is performed to increase the maximum brightness of the first non-overlapping region S4 by adjusting the first image A1, the difference between the brightness of the first non-overlapping region S4 and the brightness of the overlapping region S3 increases. When the difference increases, the difference becomes more noticeable.

[0132] In contrast, according to the above-described embodiment, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, correction for increasing the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1 is not performed. Therefore, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, correction for accentuating the difference between the brightness of the first non-overlapping region S4 and the brightness of the overlapping region S3 can be suppressed.

[0133] In the method for adjusting a projected image in the first embodiment, not performing a correction to increase the maximum brightness in the first non-overlapping region S4 by adjusting the first image A1 includes not performing a correction to adjust the first image A1.

[0134] When the technique disclosed in Patent Document 1 is applied to a case where the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the difference in brightness between the first non-overlapping region S4 and the overlapping region S3 becomes larger.

[0135] According to this embodiment, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, correction for adjusting the first image A1 is not performed, so that it is possible to prevent the difference in brightness between the first non-overlapping region S4 and the overlapping region S3 from becoming larger.

[0136] In addition, according to this embodiment, the load required to adjust the first image A1 can be reduced compared to a configuration that performs correction to adjust the first image A1 when the brightness of the first non-overlapping area S4 is brighter than the brightness of the overlapping area S3.

[0137] In the method for adjusting a projection image according to the first embodiment, the brightness of the overlap region S3 is the average brightness value in the overlap region S3, the brightness of the first non-overlap region S4 is the average brightness value in the first non-overlap region S4, and the maximum brightness value in the first non-overlap region S4 is the maximum brightness value in the first non-overlap region S4.

[0138] According to this embodiment, the adjustment of the first image A1 can be controlled based on the magnitude relationship between the average luminance value in the overlapping region S3 and the average luminance value in the first non-overlapping region S4. Therefore, even if the luminance of a part of the overlapping region S3 becomes an erroneous value due to sudden noise, the influence of the erroneous value on the adjustment of the first image A1 can be reduced by using the average luminance value in the overlapping region S3.

[0139] In the method for adjusting a projection image according to the first embodiment, the brightness of the overlap region S3 is the maximum brightness value in the overlap region S3, the brightness of the first non-overlap region S4 is the maximum brightness value in the first non-overlap region S4, and the maximum brightness value in the first non-overlap region S4 is the maximum brightness value in the first non-overlap region S4.

[0140] According to this embodiment, the adjustment of the first image A1 can be controlled based on the magnitude relationship between the maximum luminance value in the overlapping region S3 and the maximum luminance value in the first non-overlapping region S4. Therefore, for example, it is possible to eliminate the need for a process of identifying the average luminance value in the overlapping region S3 and the average luminance value in the first non-overlapping region S4.

[0141] In the method for adjusting a projected image according to the first embodiment, adjusting the first image A1 when the brightness of the first non-overlapping area S4 is darker than the brightness of the overlapping area S3 includes performing a correction to increase the maximum brightness in the first non-overlapping area S4 by adjusting the first image A1 when the brightness of the first non-overlapping area S4 is darker than the brightness of the overlapping area S3.

[0142] According to this embodiment, when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, a correction can be performed to bring the brightness of the first non-overlapping region S4 closer to the brightness of the overlapping region S3.

[0143] In the projection image adjustment method according to the first embodiment, the first image A1 and the second image A2 are monochrome black images.

[0144] According to this embodiment, in a situation where the first projector 10 and the second projector 20 project a monochrome black image, it is possible to suppress correction that accentuates the difference in brightness between the first non-overlapping area S4 and the overlapping area S3.

[0145] B: Variation The following are examples of modified aspects of the above-described embodiment. Two or more aspects selected from the following examples may be combined as appropriate to the extent that they are not mutually inconsistent.

[0146] B1: First modified example In the first embodiment, when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the correction unit 443 may execute a third correction. The third correction is a correction for adjusting the first image A1, and is not the first correction.

[0147] FIG. 14 is a diagram showing a first region S1, a second region S2, an overlapping region S3, a first non-overlapping region S4, and a second non-overlapping region S5.

[0148] The first region S1 has a first contour G1. The first contour G1 is an example of a contour that the first region has. The second region S2 has a second contour G2. The overlapping region S3 has a third contour G3. The third contour G3 is an example of a contour that the third region has. The third contour G3 includes a first line J1 that does not overlap with the first contour G1 of the first region S1. A first point K1 is located on the first line J1. The position of the first point K1 on the first line J1 is an arbitrary position on the first line J1. Therefore, the position of the first point K1 on the first line J1 is not limited to the position shown in FIG. 14. The position of the first point K1 on the first line J1 may be a position different from the position shown in FIG. 14. In addition, a plurality of first points K1 may be located on the first line J1.

[0149] The first non-overlapping region S4 has a second point K2, a third point K3, and a point group Km. The second point K2 is a point adjacent to the first point K1. The position of the second point K2 is not limited to the position shown in FIG. 14. The position of the second point K2 changes depending on the position of the first point K1 on the first line J1. The third point K3 is a point having a maximum brightness value in the first non-overlapping region S4. The maximum brightness value in the first non-overlapping region S4 is, for example, the maximum brightness value in the first non-overlapping region S4. The position of the third point K3 is not limited to the position shown in FIG. 14. The position of the third point K3 may change depending on the brightness distribution in the first non-overlapping region S4. The brightness distribution in the first non-overlapping region S4 is, for example, the brightness distribution in the first non-overlapping region S4. The point group Km is a group of points located between the third point K3 and the second point K2 in the first non-overlapping region S4. The point group Km includes one or more points.

[0150] When the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the identification unit 442 identifies the brightness of the second point K2, the maximum brightness value in the first non-overlapping region S4, and the third point K3 based on the captured image.

[0151] For example, the determination unit 442 determines the luminance of the second point K2 as the brightness of the second point K2 based on the captured image. The determination unit 442 determines the maximum luminance of the first non-overlapping region S4 as the maximum luminance of the first non-overlapping region S4 based on the captured image.

[0152] Next, the correction unit 443 executes a third correction. The third correction is a correction that changes the brightness of the point group Km and the brightness of the second point K2 to brightness within a first range by adjusting the first image A1. The first range is a range that is brighter than the brightness of the second point K2 specified based on the captured image and is equal to or less than the brightness of the third point K3 specified based on the captured image. The brightness of the third point K3 is the maximum brightness in the first non-overlapping region S4.

[0153] Fig. 15 is a diagram for explaining an example of the third correction. Before performing the example of the third correction shown in Fig. 15, the determination unit 442 determines the brightness of the first point K1 based on the captured image. For example, the determination unit 442 determines the luminance of the first point K1 as the brightness of the first point K1 based on the captured image.

[0154] Next, the correction unit 443 executes an example of the third correction shown in Fig. 15. For example, when the brightness of the first point K1 is brighter than the brightness of the second point K2, the correction unit 443 executes a correction to gradually increase the brightness of the point group Km and the brightness of the second point K2 from the third point K3 to the second point K2 without going outside the first range by adjusting the first image A1 so that the brightness of the second point K2 approaches the brightness of the first point K1.

[0155] As an example, the correction unit 443 maintains the brightness of the first superimposition image A1a in the first image A1 and partially adjusts the brightness of the first non-superimposition image A1b in the first image A1, thereby changing the brightness of the second point K2 to the brightness of the first point K1, and gradually increasing the brightness of the point cloud Km from the third point K3 to the second point K2 without departing from the first range.

[0156] During the third correction, the correction unit 443 may cause the camera 30 to continuously capture images. In this case, the correction unit 443 maintains the brightness of the first superimposition image A1a and partially adjusts the brightness of the first non-superimposition image A1b in the first image A1 while monitoring the captured images continuously generated by the camera 30. The correction unit 443 changes the brightness of the second point K2 to the brightness of the first point K1 by partially adjusting the brightness of the first non-superimposition image A1b while monitoring the captured images, and gradually increases the brightness of the point group Km from the third point K3 to the second point K2 without going outside the first range.

[0157] Fig. 16 is a diagram showing an example of the first image A1 after adjustment in the third correction. As shown in Fig. 16, the adjustment in the third correction is performed on the first non-superimposition image A1b.

[0158] In addition, when a plurality of first points K1 are located on the first line J1, the third correction is performed for each first point K1 on the second point K2 and the point group Km corresponding to that first point K1.

[0159] The third correction is not limited to the above example. For example, the correction unit 443 first identifies a point group Km1 that is darker than the brightness of the first point K1 from the point group Km. Next, the correction unit 443 may change the brightness of the point group Km1 and the brightness of the second point K2 to the brightness of the first point K1 by changing the first non-superimposition image A1b.

[0160] It should be noted that, if the brightness of the first point K1 is not brighter than the brightness of the second point K2, the corrector 443 does not execute correction to adjust the first image A1, for example.

[0161] In the method for adjusting a projected image of the first modified example, a third contour G3 of the overlap region S3 includes a first line J1 that does not overlap with a first contour G1 of the first region S1, and the first non-overlapping region S4 has a second point K2 adjacent to the first point K1 on the first line J1 and a third point K3 having the maximum brightness value in the first non-overlapping region S4, and when the brightness of the first non-overlapping region S4 is brighter than the brightness of the overlapping region S3, the method further includes adjusting the first image A1 to correct the brightness of a point group Km located between the third point K3 and the second point K2 in the first non-overlapping region S4 and the brightness of the second point K2 to a brightness within a first range, the first range being a range brighter than the brightness of the second point K2 identified based on the captured image and equal to or less than the brightness of the third point K3 identified based on the captured image.

[0162] According to this embodiment, correction that would cause brightness to exceed the maximum brightness value in the first non-overlapping region S4 is not performed on the points in the first non-overlapping region S4. Therefore, compared to the method disclosed in Patent Document 1, it is possible to prevent the difference in brightness between the first non-overlapping region S4 and the overlapping region S3 from being conspicuous. Therefore, regardless of the shape of the projection surface S, it is possible to adjust the projected image according to the magnitude relationship between the brightness of the overlapping region S3 and the brightness of the first non-overlapping region S4.

[0163] Furthermore, in the method for adjusting a projection image relating to the first modified example, correcting the brightness of the point group Km and the brightness of the second point K2 to be within a first range by adjusting the first image A1 includes, when the brightness of the first point K1 is brighter than the brightness of the second point K2, performing a correction by adjusting the first image A1 to gradually increase the brightness of the point group Km and the brightness of the second point K2 from the third point K3 to the second point K2 without straying from the first range so that the brightness of the second point K2 approaches the brightness of the first point K1.

[0164] According to this embodiment, the brightness of the point group Km and the brightness of the second point K2 are increased stepwise from the third point K3 to the second point K2 without going outside the first range by adjusting the first image A1. This makes the change in brightness from the first non-overlapping region S4 to the overlapping region S3 smooth. This makes it possible to realize a correction that makes the difference in brightness between the overlapping region S3 and the first non-overlapping region S4 less noticeable.

[0165] B2: Second variant In the first modified example, the correction section 443 may perform an adjustment on the second image A2 similar to the adjustment performed on the first image A1 in the first modified example.

[0166] In this case, the correction unit 443 performs the adjustment on the second image A2 based on the relationship between the brightness of the second non-overlapping region S5 and the overlapping region S3, not on the relationship between the brightness of the first non-overlapping region S4 and the overlapping region S3.

[0167] Fig. 17 is a diagram showing an example of the second image A2 after adjustment. As shown in Fig. 17, the adjustment to the second image A2 is performed on a second non-superimposition image A2b.

[0168] According to this embodiment, it is possible to realize a correction that makes the difference in brightness between the first non-overlapping region S4 and the overlapping region S3, and the difference in brightness between the second non-overlapping region S5 and the overlapping region S3 less noticeable.

[0169] B3: Third variant In the first embodiment and the first to second modified examples, the correction that is executed when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3 is not limited to the first correction.

[0170] For example, when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3 and there is a variation in brightness in the first non-overlapping region S4, the correction unit 443 may perform a correction to make the brightness of the entire first non-overlapping region S4 equal to the maximum brightness value in the first non-overlapping region S4 by adjusting the first image A1. Even with this correction, when the brightness of the first non-overlapping region S4 is darker than the brightness of the overlapping region S3, it is possible to reduce the difference in brightness between the first non-overlapping region S4 and the overlapping region S3.

[0171] B4: Fourth variant In the first embodiment and the first to third modified examples, the correction that is executed when the brightness of the second non-overlapping area S5 is darker than the brightness of the overlapping area S3 is not limited to the second correction.

[0172] For example, when the brightness of the second non-overlapping region S5 is darker than the brightness of the overlapping region S3 and there is a variation in brightness in the second non-overlapping region S5, the correction unit 443 may perform a correction to make the brightness of the entire second non-overlapping region S5 equal to the maximum brightness value in the second non-overlapping region S5 by adjusting the second image A2. Even with this correction, when the brightness of the second non-overlapping region S5 is darker than the brightness of the overlapping region S3, it is possible to reduce the difference in brightness between the second non-overlapping region S5 and the overlapping region S3.

[0173] B5: Fifth variant In the first embodiment and the first to fourth modified examples, the information processing device 40 may be included in the first projector 10, the second projector 20, or the camera 30. Furthermore, in the first embodiment and the first to fifth modified examples, at least the processing device 440, which is one of the components of the information processing device 40, may be included in the first projector 10, the second projector 20, or the camera 30.

[0174] B6: 6th variant In the first embodiment and the first to fifth modified examples, the projection system 1 may include one or more projectors in addition to the first projector 10 and the second projector 20. In this case, the projection system 1 displays a tiling image on the projection surface S by images projected from each projector. Adjacent images in the tiling image partially overlap each other.

[0175] C: Summary of this disclosure The following is a summary of this disclosure.

[0176] C1: Appendix 1 acquiring a captured image by capturing an image of a range including a first region and a second region of a projection surface, in a state in which a first projector projects a first image having uniform brightness toward a first region of the projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion overlapping with the first region; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; When the brightness of the fourth region is brighter than the brightness of the third region, a correction for increasing a maximum brightness in the fourth region by adjusting the first image is not performed. How to adjust the projected image.

[0177] According to the projection image adjustment method described in Supplementary Note 1, when the brightness of the fourth region, which is a non-overlapping region, is brighter than the brightness of the third region, which is an overlapping region, correction for increasing the maximum brightness of the fourth region by adjusting the first image is not executed. Therefore, when the brightness of the fourth region is brighter than the brightness of the third region, correction for accentuating the difference in brightness between the fourth region and the third region can be suppressed.

[0178] C2: Appendix 2 the contour of the third region includes a first line that does not overlap with the contour of the first region; the fourth region has a second point adjacent to the first point on the first line and a third point having a maximum brightness value in the fourth region; When the brightness of the fourth region is brighter than the brightness of the third region, and correcting a brightness of the point cloud located between the third point and the second point in the fourth region and a brightness of the second point to within a first range by adjusting the first image, the first range is a range brighter than the brightness of the second point identified based on the captured image and equal to or less than the brightness of the third point identified based on the captured image; A method for adjusting a projected image as described in Appendix 1.

[0179] According to the projection image adjustment method described in Supplementary Note 2, correction that would cause brightness to exceed the maximum brightness value in the fourth region is not performed on points in the fourth region. Therefore, compared to the method disclosed in Patent Document 1, it is possible to prevent the difference in brightness between the fourth region, which is a non-overlapping region, and the third region, which is an overlapping region, from being conspicuous. Therefore, it is possible to adjust the projection image according to the magnitude relationship between the brightness of the third region and the brightness of the fourth region, regardless of the shape of the projection surface.

[0180] C3: Appendix 3 Correcting the brightness of the point cloud and the brightness of the second point to within the first range by adjusting the first image, If the brightness of the first point is brighter than the brightness of the second point, performing a correction to gradually increase the brightness of the point cloud and the brightness of the second point from the third point to the second point without departing from the first range by adjusting the first image so that the brightness of the second point approaches the brightness of the first point; 3. A method for adjusting a projected image as described in appendix 2.

[0181] According to the method for adjusting a projected image described in Supplementary Note 3, when the brightness of the first point is brighter than the brightness of the second point, the brightness of the point group located between the third point and the second point and the brightness of the second point are increased stepwise from the third point to the second point without departing from the first range by adjusting the first image so that the brightness of the second point approaches the brightness of the first point. This makes the change in brightness from the fourth region to the third region smooth. This makes it possible to realize a correction that makes the difference in brightness between the third region and the fourth region less noticeable.

[0182] C4: Appendix 4 Not carrying out the correction is and not performing a correction to adjust the first image. A method for adjusting a projected image as described in Appendix 1.

[0183] When the technique disclosed in Patent Document 1 is applied in a case where the brightness of the fourth region, which is a non-overlapping region, is brighter than the brightness of the third region, which is an overlapping region, the difference between the brightness of the fourth region and the brightness of the third region becomes larger. According to the projection image adjustment method described in Appendix 4, when the brightness of the fourth region is brighter than the brightness of the third region, correction for adjusting the first image is not performed. Therefore, it is possible to prevent the difference between the brightness of the fourth region and the brightness of the third region from becoming larger. In addition, according to the projection image adjustment method described in Appendix 4, the load required for adjusting the first image can be reduced compared to a configuration in which correction for adjusting the first image is performed when the brightness of the fourth region is brighter than the brightness of the third region.

[0184] C5: Appendix 5 the brightness of the third region is an average value of the luminance in the third region, the brightness of the fourth region is an average value of the luminance in the fourth region, The maximum brightness value in the fourth region is the maximum luminance value in the fourth region. A method for adjusting a projection image according to any one of claims 1 to 4.

[0185] According to the projection image adjustment method described in Supplementary Note 5, the adjustment of the first image can be controlled based on the magnitude relationship between the average luminance value in the third region and the average luminance value in the fourth region. Therefore, even if the luminance of a part of the third region becomes an erroneous value due to sudden noise, the influence of the erroneous value on the adjustment of the first image can be reduced by using the average luminance value in the third region.

[0186] C6:Addendum 6 the brightness of the third region is a maximum value of the luminance in the third region, the brightness of the fourth region is a maximum value of the luminance in the fourth region, The maximum brightness value in the fourth region is the maximum luminance value in the fourth region. A method for adjusting a projection image according to any one of claims 1 to 4.

[0187] According to the projection image adjustment method described in Supplementary Note 6, the adjustment of the first image can be controlled based on the magnitude relationship between the maximum luminance value in the third region and the maximum luminance value in the fourth region. This makes it possible to eliminate the need for a process for identifying the average luminance value in the third region and the average luminance value in the fourth region, for example.

[0188] C7: Appendix 7 adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; performing a correction to increase a maximum brightness value in the fourth region by adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; 7. A method for adjusting a projection image according to any one of claims 1 to 6.

[0189] According to the method for adjusting a projected image described in Supplementary Note 7, when the brightness of the fourth region is darker than the brightness of the third region, a correction can be performed to bring the brightness of the fourth region closer to the brightness of the third region.

[0190] C8:Appendix 8 the first image and the second image are monochrome black images; A method for adjusting a projection image according to any one of claims 1 to 7.

[0191] According to the projection image adjustment method described in Appendix 8, when the first projector and the second projector project a monochrome black image, correction that accentuates the difference in brightness between the fourth area and the third area can be suppressed.

[0192] C9:Appendix 9 a first projector that projects a first image having uniform luminance onto a first region of a projection surface; a second projector that projects a second image having uniform luminance toward a second area of ​​the projection surface that has a portion overlapping with a portion of the first area; a camera that generates a captured image by capturing an image of a range including the first area and the second area in a situation where the first image is projected toward the first area and the second image is projected toward the second area; acquiring the captured image; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; Run and a processing device that, when the brightness of the fourth region is brighter than the brightness of the third region, does not perform a correction to increase the maximum brightness in the fourth region by adjusting the first image. Projection system.

[0193] According to the projection system described in Supplementary Note 9, when the brightness of the fourth region, which is a non-overlapping region, is brighter than the brightness of the third region, which is an overlapping region, correction for increasing the maximum brightness of the fourth region by adjusting the first image is not executed. Therefore, when the brightness of the fourth region is brighter than the brightness of the third region, correction for accentuating the difference in brightness between the fourth region and the third region can be suppressed.

[0194] C10: Appendix 10 acquiring a captured image by capturing an image of a range including a first region and a second region of a projection surface, in a state in which a first projector projects a first image having uniform brightness toward a first region of the projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion overlapping with the first region; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; Run When the brightness of the fourth region is brighter than the brightness of the third region, a correction for increasing the maximum brightness in the fourth region by adjusting the first image is not performed. Processing unit.

[0195] According to the processing device described in Supplementary Note 10, when the brightness of the fourth region, which is a non-overlapping region, is brighter than the brightness of the third region, which is an overlapping region, correction for increasing the maximum brightness of the fourth region by adjusting the first image is not executed. Therefore, when the brightness of the fourth region is brighter than the brightness of the third region, correction for accentuating the difference in brightness between the fourth region and the third region can be suppressed.

[0196] C11: Appendix 11 On the computer, acquiring a captured image by capturing an image of a range including a first region and a second region of a projection surface, in a state in which a first projector projects a first image having uniform brightness toward a first region of the projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion overlapping with the first region; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; Run the command, When the brightness of the fourth region is brighter than the brightness of the third region, a correction for increasing the maximum brightness in the fourth region by adjusting the first image is not performed. program.

[0197] According to the program described in Supplementary Note 11, when the brightness of the fourth region, which is a non-overlapping region, is brighter than the brightness of the third region, which is an overlapping region, correction for increasing the maximum brightness of the fourth region by adjusting the first image is not executed. Therefore, when the brightness of the fourth region is brighter than the brightness of the third region, correction for accentuating the difference in brightness between the fourth region and the third region can be suppressed. [Explanation of symbols]

[0198] 1...projection system, 10...first projector, 20...second projector, 30...camera, 40...information processing device, 110...first image processing unit, 120...first light source, 130...first light modulation device, 140...first projection optical system, 151...acquisition unit, 210...second image processing unit, 220...second light source, 230...second light modulation device, 240...second projection optical system, 310...imaging lens, 320...image sensor, 330...imaging execution unit, 410...operation device, 420...display device, 430...storage device, 440...processing device, 441...acquisition unit, 442...identification unit, 443...correction unit.

Claims

1. acquiring a captured image by capturing an image of a range including a first region and a second region in a situation where a first projector projects a first image having uniform brightness toward a first region of a projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion overlapping with the first region; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; When the brightness of the fourth region is brighter than the brightness of the third region, a correction for increasing a maximum brightness value in the fourth region by adjusting the first image is not performed. How to adjust the projected image.

2. the third region has a contour including a first line that does not overlap with a contour of the first region; the fourth region has a second point adjacent to the first point on the first line and a third point having a maximum brightness value in the fourth region; When the brightness of the fourth region is brighter than the brightness of the third region, and correcting a brightness of the point cloud located between the third point and the second point in the fourth region and a brightness of the second point to within a first range by adjusting the first image, the first range is a range brighter than the brightness of the second point identified based on the captured image and equal to or less than the brightness of the third point identified based on the captured image; The method for adjusting a projected image according to claim 1 .

3. Correcting the brightness of the point cloud and the brightness of the second point to within the first range by adjusting the first image, If the brightness of the first point is brighter than the brightness of the second point, performing a correction to gradually increase the brightness of the point cloud and the brightness of the second point from the third point to the second point without departing from the first range by adjusting the first image so that the brightness of the second point approaches the brightness of the first point; The method for adjusting a projected image according to claim 2 .

4. Not carrying out the correction is performing no correction to adjust the first image. The method for adjusting a projected image according to claim 1 .

5. the brightness of the third region is an average value of the luminance in the third region, the brightness of the fourth region is an average value of the luminance in the fourth region, The maximum brightness value in the fourth region is the maximum luminance value in the fourth region. The method for adjusting a projection image according to claim 1 .

6. the brightness of the third region is a maximum value of the luminance in the third region, the brightness of the fourth region is a maximum value of the luminance in the fourth region, The maximum brightness value in the fourth region is the maximum luminance value in the fourth region. The method for adjusting a projection image according to claim 1 .

7. When the brightness of the fourth region is darker than the brightness of the third region, adjusting the first image includes: performing a correction to increase a maximum brightness value in the fourth region by adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; The method for adjusting a projection image according to claim 1 .

8. the first image and the second image are monochrome black images; The method for adjusting a projection image according to claim 1 .

9. a first projector configured to project a first image having uniform luminance onto a first region of a projection surface; a second projector that projects a second image having uniform luminance toward a second area of ​​the projection surface that has a portion overlapping with a portion of the first area; a camera that generates a captured image by capturing an image of a range including the first area and the second area in a situation where the first image is projected toward the first area and the second image is projected toward the second area; acquiring the captured image; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; Run and a processing device that, when the brightness of the fourth region is brighter than the brightness of the third region, does not perform a correction to increase a maximum brightness in the fourth region by adjusting the first image. Projection system.

10. acquiring a captured image by capturing an image of a range including a first region and a second region in a situation where a first projector projects a first image having uniform brightness toward a first region of a projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion overlapping with the first region; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; Run When the brightness of the fourth region is brighter than the brightness of the third region, a correction for increasing the maximum brightness in the fourth region by adjusting the first image is not performed. Processing unit.

11. On the computer, acquiring a captured image by capturing an image of a range including a first region and a second region in a situation where a first projector projects a first image having uniform brightness toward a first region of a projection surface, and a second projector projects a second image having uniform brightness toward a second region of the projection surface having a portion overlapping with the first region; Identifying a brightness of a third region where the first region and the second region overlap, and a brightness of a fourth region of the first region that does not overlap with the second region, based on the captured image; adjusting the first image when the brightness of the fourth region is darker than the brightness of the third region; Run the command, When the brightness of the fourth region is brighter than the brightness of the third region, a correction for increasing the maximum brightness in the fourth region by adjusting the first image is not performed. program.

Images