Projection method, processing device, projection system, and program

Abstract

To improve convenience for a user in adjustment of projection images projected by a plurality of projectors.SOLUTION: A projection method includes: when executing first adjustment including correction of the shape of a first projection image projected by a projector, receiving an operation to change the shape of the first projection image to update a first set value for correcting the shape of the first projection image; and correcting the shape of the first projection image based on the first set value, and projecting, from the projector, a third projection image not correcting the brightness of a superimposition area in the first projection image where the first projection image and a second projection image projected by the other projector different from the above-mentioned projector are superimposed with each other.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a projection method, a processing device, a projection system, and a program. [Background technology]

[0002] Conventionally, there are known techniques for adjusting projected images projected by multiple projectors. For example, Patent Document 1 discloses setting edge blending to reduce the luminance of an overlapping area where projected images are overlapped when projecting images by multiple projectors. Furthermore, Patent Document 1 discloses performing keystone correction on the projected image according to a user operation after setting edge blending. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2014-78872 A Summary of the Invention [Problem to be solved by the invention]

[0004] The brightness correction such as edge blending disclosed in Patent Document 1 imposes a large processing load. Therefore, when performing shape correction such as keystone correction while performing brightness correction such as edge blending, the processing time for adjusting the projection image increases, and it takes time for the adjusted projection image to be projected. This has traditionally impaired user convenience when adjusting projection images projected by multiple projectors. [Means for solving the problem]

[0005] The projection method disclosed herein includes, when performing a first adjustment including correcting a shape of a first projection image projected by a projector, updating a first setting value that corrects the shape of the first projection image by accepting an operation to change the shape of the first projection image, and projecting from the projector a third projection image that corrects the shape of the first projection image based on the first setting value and does not correct the brightness of an overlapping area in the first projection image where the first projection image overlaps with a second projection image projected by a projector other than the projector.

[0006] The processing device disclosed herein includes one or more processors that, when performing a first adjustment including correcting the shape of a first projection image projected by a projector, update a first setting value that corrects the shape of the first projection image by accepting an operation to change the shape of the first projection image, and cause the projector to project a third projection image that corrects the shape of the first projection image based on the first setting value and does not correct the brightness of an overlapping area in the first projection image where a second projection image projected by a projector other than the projector and the first projection image overlap.

[0007] The projection system of the present disclosure includes a projector; and a processing device that, when performing a first adjustment including correcting the shape of a first projection image projected by the projector, updates a first setting value for correcting the shape of the first projection image by accepting an operation to change the shape of the first projection image, and causes the projector to project a third projection image that corrects the shape of the first projection image based on the first setting value and does not correct the brightness of an overlapping area in the first projection image where a second projection image projected by a projector other than the projector and the first projection image overlap.

[0008] A program disclosed herein includes, in one or more processors, when executing a first adjustment including correcting a shape of a first projection image projected by a projector, receiving an operation to change the shape of the first projection image, updating a first setting value for correcting the shape of the first projection image, correcting the shape of the first projection image based on the first setting value, and correcting a luminance of an overlapping area in the first projection image where a second projection image projected by a projector other than the projector overlaps with the first projection image. do not and causing the projector to project a third projection image. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the configuration of a projection system. [Diagram 2] FIG. 1 illustrates a configuration of a projector. [Diagram 3] FIG. 2 is a diagram showing the configuration of a control device. [Figure 4] FIG. 13 is a diagram showing an example of a manual adjustment UI. [Diagram 5] FIG. 4 is a flowchart showing the flow of image processing by a second image processing unit. [Figure 6] 4 is a flowchart showing the operation of the control device. [Figure 7] 4 is a flowchart showing the operation of the control device. [Figure 8] 4 is a flowchart showing the operation of the control device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] [1. First embodiment] FIG. 1 is a diagram showing the configuration of a projection system 1000. As shown in FIG. The projection system 1000 of this embodiment includes a plurality of projectors 1 arranged side by side. The projection system 1000 projects a plurality of projection images G side by side using the plurality of projectors 1. The projection system 1000 of this embodiment projects two projection images G side by side in the left-right direction of the screen SC in the figure, forming one large image on the screen SC. The screen SC may be a curtain-like screen, or the wall surface of a building or the flat surface of an installed object may be used as the screen SC. The screen SC is not limited to a flat surface, and may be a curved surface or a surface having irregularities.

[0011] 1, a projection system 1000 of this embodiment includes two projectors 1, projectors 1A and 1B. The two projectors 1 are installed in one vertical row and two horizontal columns.

[0012] 1, the number of projectors 1 included in the projection system 1000 is not limited to two, and may be three or more. The multiple projectors 1 may be installed in any arrangement, such as N rows and M columns, where N and M are integers equal to or greater than 1.

[0013] The projector 1 projects a projection image G onto a screen SC by outputting image light based on image data input from an image supply device. In Fig. 1, the projector 1A displays a first projection image G1 on the screen SC, which overlaps with an edge of a second projection image G2. In Fig. 1, the projector 1B displays a second projection image G2 on the screen SC, which overlaps with an edge of the first projection image G1. The control device 2 is an example of a processing device of the present disclosure.

[0014] The projection state of the projection image G shown in Fig. 1 shows the state after the projection image G has been appropriately adjusted. The adjustment of the projection image G includes alpha blending, shape correction, white balance correction, color unevenness correction, etc. The alpha blending is a process that corrects the alpha value of the projection image G to correct the brightness of the overlapping area TA where the projection images G overlap, making the boundary between adjacent projection images G less noticeable.

[0015] The projector 1 is connected to a network NW. The network NW is a network configured with communication facilities such as a public line network, a dedicated line, and other communication lines, and the specific form is not limited. For example, the network NW may be a wide area network or a local network. The network NW may include at least one of a wireless communication circuit and a wired communication circuit.

[0016] The projection system 1000 includes a control device 2. The control device 2 is connected to a network NW. The control device 2 shown in FIG. 1 is a notebook PC (Personal Computer). The control device 2 includes: Notes The control device 2 controls the projector 1 via the network NW. The control device 2 in this embodiment functions as an image supply device. The control device 2 outputs image data to each of the projectors 1A and 1B. The projector 1 projects a projection image G based on the image data received from the control device 2.

[0017] FIG. 2 is a diagram showing the configuration of the projector 1. As shown in FIG. The projector 1 includes a first control unit 10. The first control unit 10 includes a first processor 100 that executes programs such as a CPU (Central Processing Unit) and an MPU (Micro-processing unit), and a first memory 110, and controls each part of the projector 1. The functional parts of the first processor 100 will be described later.

[0018] The first memory 110 stores programs executed by the first processor 100 and data processed by the first processor 100. The first memory 110 stores a control program 111 executed by the first processor 100 and various other data. The first memory 110 has a non-volatile storage area. The first memory 110 may have a volatile storage area and constitute a work area of ​​the first processor 100. The first memory 110 is constituted by, for example, a Read Only Memory (ROM) or a Random Access Memory (RAM).

[0019] The projector 1 includes a first interface 11 . The first interface 11 includes a connector and an interface circuit that comply with a predetermined communication standard. The first interface 11 transmits and receives image data, control data, and the like to and from an external device in accordance with a predetermined communication standard under the control of the first control unit 10. The image data transmitted and received by the first interface 11 may be still image data or moving image data, and may also be accompanied by audio data. The first interface 11 of this embodiment communicates with the control device 2 via the network NW, and receives image data of the projection image G from the control device 2.

[0020] The projector 1 includes a frame memory 12 and a first image processing unit 13. The frame memory 12 and the first image processing unit 13 are configured, for example, by integrated circuits. Examples of integrated circuits include LSI, ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field-Programmable Gate Array), SoC (System-on-a-chip), etc. An analog circuit may be included as part of the configuration of the integrated circuit, or the first control unit 10 may be configured in combination with an integrated circuit.

[0021] The frame memory 12 includes a plurality of banks. Each bank has a storage capacity capable of writing one frame. The frame memory 12 is configured, for example, by a Synchronous Dynamic Random Access Memory (SDRAM).

[0022] The first image processing unit 13 performs image processing such as resolution conversion or resizing, distortion correction, geometric correction, digital zoom, and adjustment of image color and brightness on the image data expanded in the frame memory 12. The first image processing unit 13 executes processing designated by the first control unit 10, and performs processing using parameters input from the first control unit 10 as necessary. The first image processing unit 13 can also execute a combination of a plurality of the above image processes. The first image processing unit 13 outputs the image data expanded in the frame memory 12 to the drive unit 14.

[0023] The projector 1 includes a drive unit 14 and a projection unit 15 . The driving unit 14 includes a light source driving circuit that turns on or off the light source 151, and a light modulation device driving circuit. The light modulation device driving circuit drives the light modulation device 152 under the control of the first control unit 10, and draws an image on the light modulation element of the light modulation device 152 in units of frames. Image data corresponding to each of the primary colors R, G, and B is input from the first image processing unit 13 to the light modulation device driving circuit. The light modulation device driving circuit converts the input image data into a data signal suitable for the operation of the liquid crystal panel, which is the light modulation element of the light modulation device 152. The light modulation device driving circuit applies a voltage to each pixel of each liquid crystal panel based on the converted data signal, and draws an image on each liquid crystal panel.

[0024] The projection unit 15 includes a light source 151 , a light modulation device 152 , and an optical unit 153 .

[0025] The light source 151 includes a light source such as a xenon lamp, an extra-high pressure mercury lamp, an LED, a laser light source, etc. The light source 151 may also include a reflector and an auxiliary reflector that guide the light emitted from the light source to the light modulation device 152.

[0026] The light modulation device 152 includes a modulation element such as a transmissive liquid crystal panel. The light modulation device 152 modulates the light incident from the light source 151 in accordance with a data signal input from a drive circuit to form image light. The image light is typically color image light including three colors of visible light: R, G, and B. The light modulation device 152 is not limited to a transmissive liquid crystal panel, and may be, for example, a reflective liquid crystal panel or a DMD (Digital Micromirror Device).

[0027] The optical unit 153 emits the image light formed by the light modulation device 152 to the screen SC to form an image on the screen SC. The optical unit 153 includes at least one of a lens and a mirror. The optical unit 153 may include a zoom mechanism that enlarges or reduces the projection image G projected onto the screen SC, and a focus adjustment mechanism that adjusts the focus.

[0028] The first processor 100 reads out and executes a control program 111 stored in a first memory 110, thereby functioning as a first communication control unit 101 and a projection control unit 102.

[0029] The first communication control unit 101 communicates with the control device 2 via the first interface 11 .

[0030] The projection control unit 102 controls the first image processing unit 13, the drive unit 14, etc., to project the projection image G onto the screen SC. Specifically, the projection control unit 102 causes the first image processing unit 13 to process the image data expanded in the frame memory 12. At this time, the projection control unit 102 reads out parameters required for processing by the first image processing unit 13 from the first memory 110 and outputs them to the first image processing unit 13. The projection control unit 102 also controls the drive unit 14 to turn on the light source 151 using the light source drive circuit, drive the light modulation device 152 using the light modulation device drive circuit, and emit image light from the projection unit 15 to project the projection image G onto the screen SC. The projection control unit 102 also controls the optical unit 153 to start a motor and adjust the zoom and focus of the optical unit 153.

[0031] FIG. 3 is a diagram showing the configuration of the control device 2. As shown in FIG. The control device 2 includes a second control unit 20, a second interface 21, an input unit 22, and a display unit .

[0032] The second control unit 20 includes a second processor 200 that executes programs such as a CPU or an MPU, and a second memory 210, and controls each part of the control device 2. The functional parts of the second processor 200 will be described later. The second processor 200 corresponds to one or more processors of the present disclosure.

[0033] The second memory 210 stores programs executed by the second processor 200 and data processed by the second processor 200. The second memory 210 stores an APP 211 executed by the second processor 200, geometric correction parameters 212, brightness correction parameters 213, and various other data. The second memory 210 has a non-volatile storage area. The second memory 210 may have a volatile storage area and constitute a work area of ​​the second processor 200. The second memory 210 is constituted by, for example, a ROM, a RAM, etc. The APP 211 is an example of a program of the present disclosure. The geometric correction parameter 212 corresponds to a first setting value of the present disclosure. The brightness correction parameter 213 corresponds to a second setting value of the present disclosure.

[0034] The APP 211 is an application program that controls the projector 1.

[0035] The geometric correction parameters 212 are parameters for correcting the shape of the projected image G. The brightness correction parameters 213 are setting values ​​for correcting the brightness of the overlapping area TA. More specifically, the brightness correction parameters 213 are an alpha map that defines an alpha value for each pixel of the projection image G. The control device 2 obtains the initial values ​​of the brightness correction parameters 213 through input from a user or measurement by a camera or the like.

[0036] The second memory 210 stores geometric correction parameters 212 and luminance correction parameters 213 for each projector 1 controlled by the control device 2. The second memory 210 of this embodiment stores first geometric correction parameters 212A which are the geometric correction parameters 212 of projector 1A, second geometric correction parameters 212B which are the geometric correction parameters 212 of projector 1B, first luminance correction parameters 213A which are the luminance correction parameters 213 of projector 1A, and second luminance correction parameters 213B which are the luminance correction parameters 213 of projector 1B.

[0037] The control device 2 includes a second interface 21 . The second interface 21 includes a connector and an interface circuit that comply with a predetermined communication standard. The second interface 21 transmits and receives image data, control data, and the like to and from an external device in accordance with the predetermined communication standard under the control of the second control unit 20. The second interface 21 of this embodiment communicates with the projector 1 via the network NW and transmits image data of the projection image G to the projector 1.

[0038] The input unit 22 has input devices such as operation switches provided on the control device 2, a panel with a touch input function, a mouse, a keyboard, etc., detects operations on the input devices by the user, and outputs the detection results to the second control unit 20. Based on the input from the input unit 22, the second control unit 20 executes processing corresponding to the operation on the input device.

[0039] The display unit 23 includes a display, and displays information on the display according to the control of the second control unit 20. The display unit 23 includes a display including various display panels such as a liquid crystal display panel and an organic EL (Electro Luminescence) display panel.

[0040] The second processor 200 reads and executes the APP 211 to function as a second communication control unit 201, a display control unit 202, a reception unit 203, an operation mode control unit 204, and a second image processing unit 205.

[0041] The second communication control unit 201 communicates with the projector 1 via the second interface 21 .

[0042] When manual adjustment of the projection image G is performed, the display control unit 202 displays a user interface for performing the manual adjustment of the projection image G on the display unit 23. Note that manual adjustment of the projection image G refers to manually adjusting the projection image G. Hereinafter, this user interface will be referred to as a "manual adjustment UI" and will be given the reference number "230." Note that UI is an abbreviation of user interface. The manual adjustment of the projected image G corresponds to the first adjustment in this disclosure.

[0043] FIG. 4 is a diagram showing an example of the manual adjustment UI 230. As shown in FIG. The manual adjustment UI 230 displays an adjustment image TG for manually adjusting the projection image G. The projection system 1000 of this embodiment includes two projectors 1. Therefore, the manual adjustment UI 230 of this embodiment displays a first adjustment image TG1 for manually adjusting the first projection image G1 and a second adjustment image TG2 for manually adjusting the second projection image G2. The adjustment image TG is a rectangular image. The adjustment image TG has an operation point P at each of its vertices. The operation point P is a point that is operated by the user to correct the shape of the projection image G. The position of each operation point P in the manual adjustment UI 230 is changed according to the user's operation.

[0044] Each of the adjusted images TG displayed by the manual adjustment UI 230 corresponds to each of the projection images G projected onto the screen SC. In this embodiment, the first adjusted image TG1 corresponds to the first projection image G1, and the second adjusted image TG2 corresponds to the second projection image G2.

[0045] The display position, shape, and size of each of the adjusted images TG displayed by the manual adjustment UI 230 correspond to the projection position, shape, and size of the corresponding projection image G. In this embodiment, the display position, shape, and size of the first adjustment image TG1 in the manual adjustment UI 230 correspond to the projection position, shape, and size of the first projection image G1 on the screen SC. Also, in this embodiment, the display position, shape, and size of the second adjustment image TG2 in the manual adjustment UI 230 correspond to the projection position, shape, and size of the second projection image G2 on the screen SC.

[0046] In the projection system 1000, when the shape of the adjusted image TG is changed, the shape of the corresponding projected image G is changed to match the shape of the changed adjusted image TG. This allows the user to intuitively adjust the shape of the projected image G using the manual adjustment UI 230.

[0047] Returning to the description of Fig. 3, the reception unit 203 receives various operations from the user via the input unit 22. The reception unit 203 receives a drag-and-drop operation for moving the position of the operation point P via the manual adjustment UI 230. The drag-and-drop operation includes a drag operation and a drop operation.

[0048] The drag operation is an operation of selecting an operation target and changing the position of the operation target in a selected state. For example, when a user operates an operation point P with a mouse connected to the control device 2, the drag operation is an operation of moving the operation point P while clicking the operation point P. Also, for example, when a user operates the operation point P by a touch operation on a touch panel, the drag operation is an operation of moving the operation point P while touching the operation point P.

[0049] A drop operation is an operation for canceling the selection of an operation target. For example, when a user operates operation point P with a mouse connected to the control device 2, a drop operation is an operation for stopping the click on operation point P. Also, for example, when a user operates operation point P by a touch operation on a touch panel, a drop operation is an operation for stopping the touch operation on operation point P.

[0050] The operation mode control unit 204 controls the operation mode of the control device 2. The operation modes of the control device 2 in this embodiment include a non-manual adjustment mode and a manual adjustment mode. The non-manual adjustment mode is a mode in which the projected image G is not manually adjusted. The manual adjustment mode is a mode for manually adjusting the projected image G. The manual adjustment mode has a first manual adjustment mode and a second manual adjustment mode. The first manual adjustment mode is a mode in which the shape of the projected image G is corrected but the luminance of the overlapping area TA is not corrected. The second manual adjustment mode is a mode for correcting the shape of the projected image G and the luminance of the overlapping area TA.

[0051] When the reception unit 203 receives an operation to start manual adjustment, the operation mode control unit 204 switches the operation mode of the control device 2 from the non-manual adjustment mode to the manual adjustment mode. When the reception unit 203 receives an operation to end manual adjustment, the operation mode control unit 204 switches the operation mode of the control device 2 from the manual adjustment mode to the non-manual adjustment mode.

[0052] In the manual adjustment mode, when the reception unit 203 receives a drag operation of the operation point P, the operation mode control unit 204 switches the operation mode of the control device 2 from the second manual adjustment mode to the first manual adjustment mode. In the manual adjustment mode, when the reception unit 203 receives a drop operation of the operation point P, the operation mode control unit 204 switches the operation mode of the control device 2 from the first manual adjustment mode to the second manual adjustment mode.

[0053] When the operation mode of the control device 2 is the non-manual adjustment mode, the second image processing unit 205 reads out the geometric correction parameters 212 and the brightness correction parameters 213 from the second memory 210. The second image processing unit 205 generates a fourth projection image based on the two read parameters. The fourth projection image is an image in which the shape of the projection image G is corrected based on the read geometric correction parameters 212 and the overlapping area TA is alpha blended based on the read brightness correction parameters 213. The second image processing unit 205 outputs image data of the generated fourth projection image to the second communication control unit 201. The second communication control unit 201 transmits the image data of the fourth projection image to the projector 1.

[0054] In this embodiment, the second image processing unit 205 reads out the first geometric correction parameters 212A and the first luminance correction parameters 213A from the second memory 210. Then, the second image processing unit 205 corrects the shape based on the read out first geometric correction parameters 212A, and generates a fourth projection image by alpha blending the overlapping area TA based on the read out first luminance correction parameters 213A. The second communication control unit 201 transmits image data of the generated fourth projection image to the projector 1A. In this embodiment, the second image processing unit 205 reads out the second geometric correction parameters 212B and the second luminance correction parameters 213B from the second memory 210. Then, the second image processing unit 205 corrects the shape based on the read out second geometric correction parameters 212B, and generates a fourth projection image by alpha blending the overlapping area TA based on the read out second luminance correction parameters 213B. The second communication control unit 201 transmits image data of the generated fourth projection image to the projector 1B.

[0055] Here, the image processing of the second image processing unit 205 when generating the fourth projection image will be described. FIG. 5 is a diagram showing the flow of image processing by the second image processing unit 205.

[0056] The second image processing unit 205 allocates image data D1 of one image to be projected onto the screen SC by the projection system 1000 to a screen coordinate system CS1 expanded in a predetermined storage area of ​​the second memory 210. When allocating the image data D1, the second image processing unit 205 maintains the aspect of the image. Note that the screen coordinate system CS1 is a coordinate system defined with respect to the screen SC. Information on the screen coordinate system CS1 is provided to the control device 2 in advance by measurement using a camera or the like.

[0057] Next, the second image processing unit 205 converts the coordinates of the image data D1 expanded in the screen coordinate system CS1 according to first conversion information for converting the screen coordinate system CS1 into the panel coordinate system CS2-1 of the projector 1A, thereby expanding the image data D2 into the panel coordinate system CS2-1 of the projector 1A. The panel coordinate system CS2-1 is a coordinate system defined in the liquid crystal panel of the light modulation device 152. Information on the panel coordinate system CS2-1 is provided in advance to the control device 2 by input by a user or measurement using a camera or the like. Also, the first conversion information is provided in advance to the control device 2 by measurement using a camera or the like.

[0058] Next, the second image processing unit 205 performs geometric correction based on the first geometric correction parameters 212A on the image data D2 expanded in the panel coordinate system CS2-1 of the projector 1A.

[0059] Next, the second image processor 205 performs alpha blending on the geometrically corrected image data D2 based on the first brightness correction parameters 213A. The alpha map, which is the first brightness correction parameters 213A, is shown in the screen coordinate system CS1. The second image processor 205 uses the first conversion information to apply the alpha value defined in the alpha map to the image data D2 expanded in the panel coordinate system CS2-1 of the projector 1A.

[0060] 5, an image indicated by image data D2 that has been subjected to geometric correction and alpha blending becomes the fourth projection image projected by projector 1A. Through the above image processing, the second image processing unit 205 generates the fourth projection image projected by projector 1A.

[0061] The second image processing unit 205 converts the coordinates of the image data D1 expanded in the screen coordinate system CS1 according to second conversion information for converting the screen coordinate system CS1 into the panel coordinate system CS2-2 of the projector 1B, thereby expanding the image data D3 into the panel coordinate system CS2-2 of the projector 1B. The panel coordinate system CS2-2 is a coordinate system defined in the liquid crystal panel of the light modulation device 152. Information on the panel coordinate system CS2-2 is provided in advance to the control device 2 by input by a user or measurement using a camera or the like. The second conversion information is provided in advance to the control device 2 by measurement using a camera or the like.

[0062] Next, the second image processing unit 205 performs geometric correction based on the second geometric correction parameters 212B on the image data D3 expanded in the panel coordinate system CS2-2 of the projector 1B.

[0063] Next, the second image processor 205 performs alpha blending on the geometrically corrected image data D3 based on the second brightness correction parameters 213B. The alpha map, which is the second brightness correction parameters 213B, is shown in the screen coordinate system CS1. The second image processor 205 uses the second conversion information to apply the alpha value defined in the alpha map to the image data D3 expanded in the panel coordinate system CS2-2 of the projector 1B.

[0064] 5, an image indicated by image data D3 that has been subjected to geometric correction and alpha blending becomes the fourth projection image projected by projector 1B. Through the above image processing, second image processing unit 205 generates the fourth projection image projected by projector 1B.

[0065] When the operation mode of the control device 2 is the first manual adjustment mode, the second image processing unit 205 reads out from the second memory 210 the geometric correction parameters 212 of the projector 1 corresponding to the adjusted image TG in which the operation point P is being operated. The second image processing unit 205 updates the read out geometric correction parameters 212 in response to the drag operation received by the reception unit 203. More specifically, the second image processing unit 205 updates the read out geometric correction parameters 212 so that the shape of the projection image G projected by the projector 1 becomes the shape of the adjusted image TG in which the operation point P is being operated. Then, the second image processing unit 205 generates a third projection image based on the updated geometric correction parameters 212. The third projection image is an image in which the shape of the projection image G is corrected and the overlapping area TA is not alpha blended. The third projection image may be an image dedicated to manual adjustment of the projection image G. An example of an image dedicated to manual adjustment is an image in which all pixels have the same color.

[0066] The second image processing unit 205 outputs the generated image data of the third projection image to the second communication control unit 201. The second communication control unit 201 transmits the image data of the third projection image received from the second image processing unit 205 to the projector 1 corresponding to the adjustment image TG in which the operation point P is being operated.

[0067] When the operation mode of the control device 2 is the second manual adjustment mode, the second image processing unit 205 reads out the geometric correction parameters 212 and the brightness correction parameters 213 stored in the second memory 210. Next, the second image processing unit 205 updates the read out geometric correction parameters 212 so that the shape of the projection image G becomes the shape of the adjusted image TG. Also, the second image processing unit 205 updates the read out brightness correction parameters 213 so that the overlapping area TA corresponding to the area where the adjusted images TG overlap is alpha blended. Then, the second image processing unit 205 generates a fifth projection image based on the updated geometric correction parameters 212 and brightness correction parameters 213. The fifth projection image is an image in which the shape of the projection image G is corrected and the overlapping area TA is alpha blended. Note that the fifth projection image may be an image dedicated to manual adjustment of the projection image G, similar to the third projection image.

[0068] The second image processing unit 205 outputs the generated image data of the fifth projection image to the second communication control unit 201. The second communication control unit 201 transmits the image data of the fifth projection image to the projector 1.

[0069] In this embodiment, when the operation mode of the control device 2 is the second manual adjustment mode, the second image processing unit 205 reads out and updates the geometric correction parameters 212 and the brightness correction parameters 213 of each of the projectors 1A and 1B. Next, the second image processing unit 205 generates a fifth projection image for each of the first projection image G1 and the second projection image G2. Then, the second communication control unit 201 transmits image data of the corresponding fifth projection image to each of the projectors 1A and 1B.

[0070] Next, the operation of the control device 2 relating to the adjustment of the projection image G will be described. FIG. 6 is a flowchart FA showing the operation of the control device 2.

[0071] The second image processor 205 determines whether the operation mode of the control device 2 is the manual adjustment mode or the non-manual adjustment mode (step SA1).

[0072] When the second image processing unit 205 determines that the operation mode of the control device 2 is the non-manual adjustment mode (step SA1: non-manual adjustment mode), it generates a fourth projection image (step SA2). In this embodiment, the second image processing unit 205 generates a fourth projection image for each of the projectors 1A and 1B.

[0073] Next, the second communication control unit 201 transmits the image data of the fourth projection image generated in step SA2 to the projector 1 (step SA3). In this embodiment, the second communication control unit 201 transmits the image data of the fourth projection image to each of the projectors 1A and 1B. The projection control units 102 of the projectors 1A and 1B project the fourth projection image indicated by the image data received by the first communication control unit 101.

[0074] Next, the second processor 200 determines whether the power of the control device 2 is off (step SA4). If the second processor 200 determines that the power of the control device 2 is not off (step SA4: NO), the process returns to step SA1. On the other hand, if the second processor 200 determines that the power of the control device 2 is off (step SA4: YES), the process ends.

[0075] Returning to the explanation of step SA1, if the second image processing unit 205 determines that the operation mode of the control device 2 is manual adjustment mode (step SA1: manual adjustment mode), it determines whether the reception unit 203 has received a drag operation on the operation point P (step SA5).

[0076] If second image processing unit 205 determines that reception unit 203 has not received a drag operation on operation point P (step SA5: NO), second processor 200 returns the process to step SA1.

[0077] On the other hand, if the second image processing unit 205 determines that the receiving unit 203 has received a drag operation on the operation point P (step SA5: YES), it determines whether the operation mode of the control device 2 is the first manual adjustment mode or the second manual adjustment mode (step SA6).

[0078] When the second image processing unit 205 determines that the operation mode of the control device 2 is the first manual adjustment mode (step SA6: first manual adjustment mode), it reads out the geometric correction parameters 212 from the second memory 210, and updates the read out geometric correction parameters 212 in accordance with the drag operation (step SA7). For example, when the operation point P being dragged is a vertex of the first adjustment image TG1, the second image processing unit 205 reads out the geometric correction parameters 212 of the projector 1A, and updates the read out geometric correction parameters 212 in accordance with the drag operation.

[0079] Next, the second image processing unit 205 generates a third projection image based on the geometric correction parameters 212 updated in step SA7 (step SA8).

[0080] Next, the second communication control unit 201 transmits the image data of the third projection image generated in step SA8 to the projector 1 (step SA9). The projector 1 to which the image data of the third projection image is transmitted in step SA9 is the projector 1 corresponding to the adjustment image TG in which the operation point P is being operated by a drag operation. For example, when the operation point P being dragged is a vertex of the first adjustment image TG1, Second communication control unit 201 transmits image data of the third projection image to the projector 1A. For example, when the operation point P being dragged is a vertex of the second adjustment image TG2, Second communication control unit 201 The first communication control unit 101 transmits image data of the third projection image to the projector 1 B. The projection control unit 102 of the projector 1 projects the third projection image indicated by the image data received by the first communication control unit 101.

[0081] Next, the second image processing unit 205 determines whether the operation mode of the control device 2 is the manual adjustment mode or the non-manual adjustment mode (step SA10). If the second image processing unit 205 determines that the operation mode is the manual adjustment mode (step SA10: manual adjustment mode), the second processor 200 returns the process to step SA5.

[0082] On the other hand, when the second image processing unit 205 determines that the operation mode of the control device 2 is the non-manual adjustment mode (step SA10: non-manual adjustment mode), it updates the brightness correction parameters 213 (step SA11). In step SA11, the second image processing unit 205 updates the brightness correction parameters 213 so that the overlapping area TA corresponding to the area where the adjusted images TG overlap is alpha blended.

[0083] Next, the second image processing unit 205 overwrites and saves the geometric correction parameters 212 updated in step SA7 and the luminance correction parameters 213 updated in step SA11 in the second memory 210 (step SA12). Next, the second processor 200 returns the process to step SA 2 Proceed to next step.

[0084] Returning to the explanation of step SA6, if the second image processing unit 205 determines that the operating mode of the control device 2 is the second manual adjustment mode (step SA6: second manual adjustment mode), it reads out the geometric correction parameters 212 and the brightness correction parameters 213 from the second memory 210 and updates the two read parameters (step SA13).

[0085] Next, the second image processing unit 205 performs step SA 13 The second image processing unit 205 generates a fifth projection image based on the geometric correction parameters 212 and the luminance correction parameters 213 updated in step SA14. In this embodiment, the second image processing unit 205 generates a fifth projection image for each of the projectors 1A and 1B.

[0086] Next, the second communication control unit 201 transmits the image data of the fifth projection image generated in step SA14 to the projector 1 (step SA15). In this embodiment, the second communication control unit 201 transmits the image data of the fifth projection image to each of the projectors 1A and 1B. The projection control units 102 of the projectors 1A and 1B project the fifth projection image indicated by the image data received by the first communication control unit 101.

[0087] Next, the second image processing unit 205 determines whether the operation mode of the control device 2 is the manual adjustment mode or the non-manual adjustment mode (step SA16). If the second image processing unit 205 determines that the operation mode is the manual adjustment mode (step SA16: manual adjustment mode), the second processor 200 returns the process to step SA5.

[0088] On the other hand, when the second image processing unit 205 determines that the operation mode of the control device 2 is the non-manual adjustment mode (step SA16: non-manual adjustment mode), 13 The second processor 200 then overwrites and saves the updated geometric correction parameters 212 and luminance correction parameters 213 in the second memory 210 (step SA17). 2 Proceed to next step.

[0089] [2. Second embodiment] Next, a second embodiment will be described. The configuration of each part of the projection system 1000 in the second embodiment is common to that of the first embodiment, and therefore illustration and description of the configuration of each part of the projection system 1000 will be omitted.

[0090] The second embodiment is different from the first embodiment in the manual adjustment mode and the operation of the control device 2. The manual adjustment mode of this embodiment is a mode in which the shape of the projected image G is corrected and the overlapping area TA is not alpha blended. In other words, the manual adjustment mode of this embodiment does not include the second manual adjustment mode.

[0091] FIG. 7 is a flowchart FB showing the operation of the control device 2 of the second embodiment. In the flowchart FB shown in FIG. 7, the same steps as those in the flowchart FA shown in FIG. 6 are designated by the same step numbers, and detailed description thereof will be omitted.

[0092] In this embodiment, if it is determined in step SA5 that the reception unit 203 has received a drag operation (step SA5: YES), the second processor 200 transitions the process to step SA7.

[0093] [3. Third embodiment] Next, a third embodiment will be described. The configuration of each part of the projection system 1000 in the third embodiment is common to that of the first embodiment, and therefore illustration and description of the configuration of each part of the projection system 1000 will be omitted.

[0094] The third embodiment is different from the first and second embodiments in the operation mode of the control device 2, the operation of the display control unit 203, the operation of the operation mode control unit 204, and the operation of the control device 2.

[0095] The operation modes of the control device 2 in this embodiment include a geometric correction mode and a non-geometric correction mode. The geometric correction mode is a mode in which geometric correction is manually performed on the projected image G. The geometric correction mode is a mode corresponding to the first manual adjustment mode described above. The non-geometric correction mode is a mode in which geometric correction of the projected image G is not performed manually. Manually performing the geometric correction of the projected image G corresponds to the first adjustment of the present disclosure.

[0096] The display control unit 203 of the third embodiment displays a manual adjustment UI 230 on the display unit 23 when the geometric correction of the projection image G is executed manually.

[0097] When the reception unit 203 receives an operation to start manual geometric correction, the operation mode control unit 204 of the third embodiment switches the operation mode of the control device 2 from the non-geometric correction mode to the geometric correction mode. When the reception unit 203 receives an operation to end manual geometric correction, the operation mode control unit 204 of the third embodiment switches the operation mode of the control device 2 from the geometric correction adjustment mode to the non-geometric correction adjustment mode.

[0098] FIG. 8 is a flowchart FC showing the operation of the control device 2 of the third embodiment. In the flowchart FC shown in FIG. 8, the same steps as those in the flowchart FB shown in FIG. 7 are given the same step numbers, and detailed descriptions thereof will be omitted.

[0099] In step SC1, the second image processing unit 205 determines whether the operation mode of the control device 2 is the geometric correction mode or the non-geometric correction mode.

[0100] If the second image processing unit 205 determines that the operation mode of the control device 2 is the non-geometric correction mode (step SC1: non-geometric correction mode), the process proceeds to step SA3. On the other hand, if the second image processing unit 205 determines that the operation mode of the control device 2 is the geometric correction mode (step SC1: geometric correction mode), the process proceeds to step SA5.

[0101] In step SC2, the second image processing unit 205 determines whether the operation mode of the control device 2 is the geometric correction mode or the non-geometric correction mode. If the second image processing unit 205 determines that the operation mode is the geometric correction mode (step SC2: geometric correction mode), the second processor 200 returns the process to step SA5.

[0102] On the other hand, when the second image processing unit 205 determines that the operation mode of the control device 2 is the non-geometric correction mode (step SC2: non-geometric correction mode), the process proceeds to step SA11.

[0103] [4. Other embodiments] The above-described embodiment is a preferred embodiment of the present disclosure. However, the present disclosure is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the present disclosure.

[0104] In the above-described embodiment, the case where the control device 2 is the processing device of the present disclosure has been exemplified. However, the processing device of the present disclosure is not limited to the control device 2. The processing device of the present disclosure may be an electronic device such as a video distributor having a function of adjusting the projection image G. The processing device of the present disclosure may also be the projector 1. In this case, the control device 2 may be built into the projector 1. When the processing device of the present disclosure is the projector 1, the projector 1 mainly adjusts the projection image G. When the processing device of the present disclosure is the projector 1, the projector 1 receives a drag-and-drop operation by a remote control, a connected mouse, or, in the case of an interactive projector, an electronic pen or a touch operation on the screen SC.

[0105] In the above-described embodiment, the operation of changing the positions of the vertices has been exemplified as the operation of changing the shape of the projection image G. In other embodiments, the operation of changing the shape of the projection image G may be an operation of changing the positions of the contours that indicate the shape of the projection image G.

[0106] In the above embodiment, alpha blending is exemplified as the luminance correction of the overlapping area TA. However, the luminance correction of the overlapping area TA is not limited to alpha blending, and any type of processing may be used as long as the processing corrects the luminance to make the boundary between adjacent projection images G less noticeable. In addition, the correction of the brightness of the overlap area TA may be a process that includes a correction to adjust either the brightness or saturation of each projected image G that includes the overlap area TA, or it may be a process that includes a correction to adjust both the brightness and saturation of each projected image G.

[0107] In the above-described embodiment, the control device 2 is an image supply device. In other embodiments, the control device 2 does not need to function as an image supply device. In this case, when the manual adjustment is completed, the control device 2 transmits the updated geometric correction parameters 212 and luminance correction parameters 213 to the projector 1, and applies the updated geometric correction parameters 212 and luminance correction parameters 213 to the projector 1. Then, the projector 1 corrects the projection image G using the two received parameters, and projects the corrected projection image G.

[0108] Furthermore, the functions of the first processor 100 and the second processor 200 may be realized by multiple processors or semiconductor chips.

[0109] Moreover, each part of the projector 1 shown in FIG. 2 and each part of the control device 2 shown in FIG. 3 show functional configurations, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional part individually, and a configuration in which one processor executes a program to realize multiple functions may be used. Also, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other parts of the projector 1 and the control device 2 may also be changed arbitrarily without departing from the spirit of the present disclosure.

[0110] In addition, the processing units in the flowcharts shown in Figures 6, 7, and 8 are divided according to the main processing contents in order to facilitate understanding of the processing of the control device 2, and the present disclosure is not limited by the manner in which the processing units are divided or the names thereof. The processing units may be divided into many step units according to the processing contents. Also, the processing units may be divided so that one step unit includes many processes. Also, the order of the steps may be appropriately changed within a range that does not impede the purpose of the present disclosure.

[0111] 5. Summary of this Disclosure The following is a summary of this disclosure. (Additional Note 1) A projection method including: when performing a first adjustment including correcting a shape of a first projection image projected by a projector, updating a first setting value that corrects the shape of the first projection image by accepting an operation to change the shape of the first projection image; and projecting from the projector a third projection image that corrects the shape of the first projection image based on the first setting value and does not correct the brightness of an overlapping area in the first projection image where the first projection image overlaps with a second projection image projected by a projector other than the projector.

[0112] As a result, in the adjustment including correction of the shape of the projection image, the brightness of the overlapping area where the projection images overlap is not corrected, so the time required for the adjusted projection image to be projected can be shortened, thereby improving the convenience for users in adjusting the projection images projected by multiple projectors.

[0113] (Supplementary Note 2) The projection method described in Supplementary Note 1, wherein when an operation to end the first adjustment is received during execution of the first adjustment, the projection image projected from the projector is changed from the third projection image to a fourth projection image in which the brightness and shape of the first projection image are corrected based on the first setting value and a second setting value that corrects the brightness.

[0114] This allows the projection image to be projected after the adjustment, including the correction of the shape of the projection image, has been completed, with the correction of the brightness of the overlapping area in addition to the shape. Therefore, after adjusting the projection image, the user can check whether the brightness of the overlapping area has been appropriately adjusted along with the shape.

[0115] (Supplementary Note 3) The projection method according to Supplementary Note 1 or 2, wherein the first adjustment indicates adjustment of the first projection image in response to an operation received from a user.

[0116] This allows the time required for the manually adjusted projection image to be projected to be reduced when an operation to adjust the projection image is received from the user, since the brightness of the overlapping area where the projection image is overlapped is not corrected, thereby improving the convenience for the user in manually adjusting the projection image.

[0117] (Appendix 4) A projection method according to any one of Appendices 1 to 3, wherein accepting an operation to change the shape of the first projected image includes accepting a change in the position of a contour indicating the shape of the first projected image, or a change in the position of a vertex of the first projected image.

[0118] This allows the operation to change the shape of the first projected image to be accepted by changing the position of the contour or vertices, allowing the user to intuitively adjust the projected image, thereby further improving the convenience for the user in adjusting the projected images projected by multiple projectors.

[0119] (Supplementary Note 5) The projection method according to Supplementary Note 4, wherein accepting a change in the position of the contour or the vertices includes accepting a drag-and-drop operation for moving the position of the contour or the vertices.

[0120] This allows the user to change the shape of the first projection image by drag-and-drop, allowing the user to adjust the projection image more intuitively, thereby improving the convenience for the user when adjusting the projection images projected by multiple projectors.

[0121] (Supplementary Note 6) The projection method according to Supplementary Note 5, wherein the first adjustment indicates an adjustment that corrects the shape of the first projected image by accepting a drag operation that moves the position of the contour or the vertex.

[0122] This prevents the brightness of the overlapping area from being corrected while the contour or apex position is being moved by a drag operation, which allows the user to quickly check the shape of the projected image that reflects the movement of the contour or apex position after the contour or apex is moved, thereby further improving user convenience in adjusting the projected image.

[0123] (Additional Note 7) A processing device having one or more processors that, when performing a first adjustment including correcting a shape of a first projection image projected by a projector, updates a first setting value that corrects the shape of the first projection image by accepting an operation to change the shape of the first projection image, and has the projector project a third projection image that corrects the shape of the first projection image based on the first setting value and does not correct the brightness of an overlapping area in the first projection image where a second projection image projected by a projector other than the projector and the first projection image overlap.

[0124] This provides the same effect as the projection method described in Supplementary Note 1.

[0125] (Appendix 8) A projection system comprising: a projector; and a processing device that, when performing a first adjustment including correcting a shape of a first projection image projected by the projector, updates a first setting value for correcting the shape of the first projection image by accepting an operation to change the shape of the first projection image, and has the projector project a third projection image that corrects the shape of the first projection image based on the first setting value and does not correct the brightness of an overlapping area in the first projection image where a second projection image projected by a projector other than the projector and the first projection image overlap.

[0126] This provides the same effect as the projection method described in Supplementary Note 1.

[0127] (Supplementary Note 9) When one or more processors execute a first adjustment including correction of a shape of a first projection image projected by a projector, a first setting value for correcting the shape of the first projection image is updated by accepting an operation for changing the shape of the first projection image, and the shape of the first projection image is corrected based on the first setting value, and a luminance of an overlapping area in the first projection image where a second projection image projected by a projector other than the projector overlaps with the first projection image is corrected. do not and causing the projector to project a third projection image.

[0128] This provides the same effect as the projection method described in Supplementary Note 1. [Explanation of symbols]

[0129] 1, 1A, 1B...projector, 2...control device (processing device), 20...second control unit, 21...second interface, 22...input unit, 200...second processor (one or more processors), 201...second communication control unit, 203...reception unit, 204...operation mode control unit, 205...second image processing unit, 210...second memory, 211...APP (program), 212...geometric correction parameter (first set value), 213...brightness correction parameter (second set value), 1000...projection system, G...projected image, G1...first projected image, G2...second projected image, NW...network, SC...screen, TA...overlapping area.

Claims

1. When a first adjustment including correction of the shape of a first projection image projected by a projector is performed, updating a first setting value for correcting a shape of the first projection image by receiving an operation for changing the shape of the first projection image; correcting a shape of the first projection image based on the first setting value, and projecting a third projection image from the projector, in which a process of correcting luminance in an overlapping area where the first projection image and a second projection image projected by a projector other than the projector are overlapped is not performed; Including, When the first adjustment is executed, if an operation to end the first adjustment is received, changing a projection image projected from the projector from the third projection image to a fourth projection image obtained by correcting the luminance and shape of the first projection image based on the first setting value and a second setting value for correcting the luminance; A projection method comprising:

2. the first adjustment indicates an adjustment of the first projection image in response to an operation received from a user; The projection method according to claim 1 .

3. Receiving an operation to change the shape of the first projection image includes: receiving a change in a position of a contour indicating a shape of the first projected image, or a change in a position of a vertex of the first projected image; The projection method according to claim 1 .

4. Accepting a change in the position of the contour or the vertices includes: receiving a drag-and-drop operation for moving a position of the contour or the vertices; The projection method according to claim 3 .

5. the first adjustment indicates an adjustment for correcting the shape of the first projection image by accepting a drag operation for moving a position of the contour or the vertex; The projection method according to claim 4.

6. When executing a first adjustment including correction of the shape of a first projection image projected by the projector, updating a first setting value for correcting a shape of the first projection image by receiving an operation for changing the shape of the first projection image; correcting a shape of the first projection image based on the first setting value, and having the projector project a third projection image in which a process of correcting luminance in an overlapping area where a second projection image projected by a projector other than the projector and the first projection image are overlapped is not performed; When the first adjustment is executed, if an operation to end the first adjustment is received, changing a projection image projected from the projector from the third projection image to a fourth projection image obtained by correcting the luminance and shape of the first projection image based on the first setting value and a second setting value for correcting the luminance; one or more processors executing Processing unit.

7. A projector and When a first adjustment including correction of a shape of a first projection image projected by the projector is executed, updating a first setting value for correcting a shape of the first projection image by receiving an operation for changing the shape of the first projection image; correcting a shape of the first projection image based on the first setting value, and projecting a third projection image in which a process of correcting luminance in an overlapping area in which a second projection image projected by a projector other than the projector and the first projection image are overlapped is not performed, When the first adjustment is executed, if an operation to end the first adjustment is received, changing a projection image projected from the projector from the third projection image to a fourth projection image obtained by correcting the luminance and shape of the first projection image based on the first setting value and a second setting value for correcting the luminance; and a processing device for executing Projection system.

8. One or more processors, When executing the first adjustment including correcting the shape of the first projection image projected by the projector, updating a first setting value for correcting a shape of the first projection image by receiving an operation for changing the shape of the first projection image; correcting a shape of the first projection image based on the first setting value, and having the projector project a third projection image in which a process of correcting luminance in an overlapping area where a second projection image projected by a projector other than the projector and the first projection image are overlapped is not performed; When the first adjustment is executed, if an operation to end the first adjustment is received, changing a projection image to be projected from the projector from the third projection image to a fourth projection image obtained by correcting the luminance and the shape of the first projection image based on the first setting value and a second setting value for correcting the luminance; program.

Images