Projection method and projection system

Abstract

To provide a projection method for improving accuracy of displaying an image displayed by tiling projection.SOLUTION: A projection method includes: acquiring, when superimposing an image projected by a projector 100A and a part of an image projected by a projector 100B, information indicating resolution of a tiling area 20 of a projection surface 10 for displaying images on the basis of a first picked-up image and a second picked-up image; acquiring a parameter for correcting the image projected by the projector 100A on the basis of the first picked-up image and the second picked-up image; acquiring a parameter for correcting the image projected by the projector 100B on the basis of the first picked-up image and the second picked-up image; creating a first projection image on the basis of an input image, the information indicating the resolution, and a first correction parameter; and creating a second projection image on the basis of the input image, the information indicating the resolution, and a second correction parameter.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a projection method and a projection system. [Background technology]

[0002] 2. Description of the Related Art Tiling projection is a conventional technique in which images projected by a plurality of projectors are arranged on a projection surface to display a single image. For example, the projector described in Patent Document 1 acquires resolution information from other connected projectors, calculates the resolution of the projection area in tiling projection by adding up the resolutions of each projector, and notifies the image supply device that supplies the image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-39019 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the resolution of the projection area calculated by adding the resolutions may differ from the resolution of the projection area that is actually projected, and in order to display the image more accurately on the projection surface, it is necessary to more accurately determine the resolution of the projection area. [Means for solving the problem]

[0005] A projection method according to the present disclosure includes acquiring a first captured image of a projection surface onto which a first image is projected by a first projector, acquiring a second captured image of the projection surface onto which a second image is projected by a second projector, acquiring information indicating a resolution of the projection area based on the first captured image and the second captured image when a tiling image is displayed in a projection area of ​​the projection surface by the first projector and the second projected image projected by the second projector, and acquiring a first correction parameter for correcting the image projected by the first projector. The projection method includes acquiring a first correction parameter based on the first captured image and the second captured image, acquiring a second correction parameter for correcting an image to be projected by the second projector based on the first captured image and the second captured image, projecting the first projection image onto the projection surface, the first projection image being generated based on an input image, information indicating the resolution, and the first correction parameter, and projecting the second projection image onto the projection surface, the second projector being generated based on the input image, information indicating the resolution, and the second correction parameter.

[0006] A projection system according to the present disclosure includes an imaging device that acquires a first captured image of a projection surface onto which a first image is projected by a first projector and a second captured image of the projection surface onto which a second image is projected by a second projector; and when a tiling image is displayed in a projection area of ​​the projection surface using the first projected image projected by the first projector and the second projected image projected by the second projector, the imaging device acquires information indicating a resolution of the projection area based on the first captured image and the second captured image; and a first correction parameter that corrects the image projected by the first projector. The projection system includes a control device that executes acquiring a first correction parameter based on the first captured image and the second captured image, and acquiring a second correction parameter that corrects an image projected by the second projector based on the first captured image and the second captured image; the first projector that projects a first projection image onto the projection surface, the first projection image being generated based on an input image, information indicating the resolution, and the first correction parameter; and the second projector that projects a second projection image being generated based on the input image, information indicating the resolution, and the second correction parameter.

[0007] A projection system according to the present disclosure includes an imaging device that captures a first captured image of a projection surface onto which a first image is projected by a first projector and a second captured image of the projection surface onto which a second image is projected by a second projector; and when a tiling image is displayed in a projection area of ​​the projection surface using the first projection image projected by the first projector and the second projection image projected by the second projector, the imaging device acquires information indicating a resolution of the projection area based on the first captured image and the second captured image, acquires first correction parameters for correcting the image projected by the first projector based on the first captured image and the second captured image, and acquires second correction parameters for correcting the image projected by the second projector based on the first captured image. and the second captured image, transmitting information indicating the resolution of the projection area and the first correction parameter to the first projector, and transmitting the information indicating the resolution of the projection area and the second correction parameter to the second projector; the first projector, when connected to the control device, transmitting EDID including the information indicating the resolution to the control device, projecting a first projection image generated based on an input image, the information indicating the resolution, and the first correction parameter; and the second projector, projecting a second projection image generated based on the input image, the information indicating the resolution, and the second correction parameter onto the projection surface. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a system configuration diagram of a projection system. [Figure 2] FIG. 1 is a block diagram showing the configuration of a projector. [Figure 3] FIG. 2 is a diagram showing the configuration of an image projection unit. [Figure 4] FIG. 1 is a block diagram showing the configuration of an information processing device. [Figure 5] FIG. [Figure 6] 10 is a flowchart showing the operation of the information processing device. [Figure 7] 10 is a flowchart showing the operation of the projector. [Figure 8] 10 is a flowchart showing details of step SA1. [Figure 9] FIG. 10 is a diagram showing an example of a pattern image expanded in a panel area. [Figure 10] FIG. 10 is a diagram showing second coordinates in which four vertices of a pattern image are plotted. [Figure 11] FIG. 10 is a diagram showing a state in which two straight lines L1 and L2 are set on a second coordinate system. [Figure 12] FIG. 10 is a diagram showing the state in which two straight lines L1 and L2 set on the second coordinate system are translated in parallel. [Figure 13] FIG. 10 is a diagram showing the intersections of straight lines L1 and L2 with a pattern image. [Figure 14] FIG. 10 is a diagram showing a projective transformation from second coordinates to first coordinates. [Figure 15] FIG. 10 is a diagram showing a projective transformation from the second coordinate system to the third coordinate system. [Figure 16] FIG. 10 is a diagram showing a projective transformation from the second coordinate system to the third coordinate system. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Projection system configuration] FIG. 1 is a diagram showing the system configuration of a projection system 1. As shown in FIG. The projection system 1 includes a plurality of projectors 100, a camera 200, and an information processing device 300. The camera 200 corresponds to an imaging device, and the information processing device 300 corresponds to a control device.

[0010] In this embodiment, a case will be described in which the projection system 1 includes two projectors 100, a projector 100A and a projector 100B, but the number of projectors 100 is not limited to two and may be three or more. In addition, hereinafter, when the projector 100A and the projector 100B are collectively referred to, they will be referred to as projector 100.

[0011] The camera 200 and the information processing device 300 are connected by a cable 3 that complies with standards such as USB (Universal Serial Bus). The information processing device 300, the projector 100A, and the projector 100B are daisy-chain connected by a cable 5. For example, a cable conforming to standards such as HDMI (High-Definition Multimedia Interface), DisplayPort, or USB Type-C is used as the cable 5. HDMI is a registered trademark.

[0012] Furthermore, the projector 100A, the projector 100B, and the information processing device 300 are connected to a wireless network 9 constructed by a wireless router . The wireless router 7 functions as an access point and relays data transmission and reception between devices connected to the wireless network 9. The wireless router 7 also functions as a router, connects to a network such as the Internet via a modem (not shown), and relays data transmission and reception between devices connected to the network and devices connected to the wireless network 9.

[0013] The camera 200 includes an imaging lens and an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS), and generates a captured image in response to a user operation or an instruction from the information processing device 300. The camera 200 transmits the generated captured image to the information processing device 300. The camera 200 is installed so that the entire projection surface 10 is included within its angle of view. Therefore, the captured image of the camera 200 includes an image of the entire projection surface 10. The imaging lens and imaging element are not shown in the drawings.

[0014] The information processing device 300 is a device that supplies an image signal containing image data to the projector 100A. The projector 100A outputs the image signal received from the information processing device 300 to the daisy-chain connected projector 100B. The projectors 100A and 100B extract image data contained in the received image signal and project image light based on the extracted image data onto the projection surface 10.

[0015] The information processing device 300 may be, for example, a notebook PC (Personal Computer), a desktop PC, a tablet PC, a smartphone, a PDA (Personal Digital Assistant), or the like.

[0016] [Projector configuration] FIG. 2 is a block diagram showing the configuration of the projector 100A. Projectors 100A and 100B have approximately the same configuration. Therefore, the configuration of projector 100A will be described below, and a description of the configuration of projector 100B will be omitted. Furthermore, in the following, to distinguish between the configurations of projector 100A and projector 100B, the configuration of projector 100A will be denoted by the symbol "A" and the configuration of projector 100B will be denoted by the symbol "B".

[0017] The projector 100A includes a remote control receiver 101A, a first wireless interface 110A, a first wired interface 120A, an image processor 130A, a frame memory 135A, an image projection unit 140A, and a first controller 150A. Hereinafter, interface will be abbreviated as I / F.

[0018] The remote control light receiving unit 101A receives an infrared signal transmitted from the remote control 105, and outputs an operation signal corresponding to the operation content indicated by the received infrared signal to the first control unit 150A.

[0019] The first wireless I / F 110A is an interface that performs wireless communication with external devices including the information processing device 300. For example, the first wireless I / F 110A includes a wireless LAN (Local Area Network) card, performs wireless communication with external devices, and transmits and receives various information. The first wireless I / F 110A may include an interface circuit and a wireless antenna.

[0020] The first wired I / F 120A is an interface that is communicably connected to the information processing device 300 and the projector 100B, receives image signals transmitted from the information processing device 300, and transmits the received image signals to the projector 100B. The first wired I / F 120A uses an interface that complies with standards such as HDMI, DisplayPort, and USB Type-C.

[0021] The first wired I / F 120A includes an input terminal 121A, a receiving circuit 123A, a transmitting circuit 125A, and an output terminal 127A.

[0022] The input terminal 121A is connected to the cable 5 and is a terminal for inputting an image signal via the cable 5. The receiving circuit 123A receives an image signal input to the input terminal 121A. The receiving circuit 123A extracts a synchronization signal and image data contained in the received image signal. The receiving circuit 123A outputs the extracted synchronization signal and image data to the image processing unit 130A. The receiving circuit 123A also outputs the received image signal to the transmitting circuit 125A.

[0023] The output terminal 127A is connected to the cable 5 and outputs an image signal to the cable 5. The transmission circuit 125A transmits the data input from the first control unit 150A and the image signal input from the reception circuit 123A via the cable 5 to the subsequent projector 100B.

[0024] A frame memory 135A is connected to the image processing unit 130A. The image processing unit 130A expands the image data input from the first wired I / F 120A in the frame memory 135A. The frame memory 135A is configured by, for example, a Synchronous Dynamic Random Access Memory (SDRAM).

[0025] The image processing unit 130A performs image processing such as resolution conversion or resizing, distortion correction, shape correction, digital zooming, and adjustment of image color and brightness on the image data stored in the frame memory 135A. The image processing unit 130A executes image processing specified by the first control unit 150A, and performs processing using parameters input from the first control unit 150A as necessary. Of course, the image processing unit 130A can also execute a combination of multiple image processing operations described above. The image processing unit 130A reads the processed image data from the frame memory 135A and outputs the read image data to the image projection unit 140A.

[0026] The image processing unit 130A and the frame memory 135A are configured, for example, by integrated circuits. Examples of integrated circuits include large-scale integrated circuits (LSIs), application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), and system-on-a-chips (SoCs). An analog circuit may be included as part of the integrated circuit configuration, or the first control unit 150A may be configured in combination with an integrated circuit.

[0027] FIG. 3 is a diagram showing the configuration of image projection section 140A. Here, the configuration of the image projection unit 140A will be described with reference to FIG. The image projection section 140A includes a light source 141A, a light modulation device 142A, an optical unit 145A, and a panel driving section 146A.

[0028] The light source 141A includes a discharge lamp such as an extra-high pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light emitting diode or a semiconductor laser. The light emitted from the light source 141A is incident on the light modulation device 142A.

[0029] The light modulation device 142A includes a color separation optical system that separates light incident from the light source 141A into red, blue, and green light, a plurality of light modulation elements that modulate the respective color lights, and a color synthesis optical system that synthesizes the respective color lights to generate image light. The color separation optical system and the color synthesis optical system are not shown. The light modulation device 142A of this embodiment includes a transmissive liquid crystal panel 143A as a light modulation element. The liquid crystal panel 143A is configured, for example, by a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. A liquid crystal panel 143A is provided for each of the colors red, green, and blue. In FIG. 3, the liquid crystal panel 143A to which red light is incident is referred to as liquid crystal panel 143A(R). Similarly, in FIG. 3, the liquid crystal panel 143A to which green light is incident is referred to as liquid crystal panel 143A(G). 3, the liquid crystal panel 143A onto which blue light is incident is referred to as liquid crystal panel 143A(B). Furthermore, when the liquid crystal panel 143A(R), the liquid crystal panel 143A(G), and the liquid crystal panel 143A(B) are collectively referred to as liquid crystal panel 143A.

[0030] The liquid crystal panel 143A(R), the liquid crystal panel 143A(G), and the liquid crystal panel 143A(B) are provided with panel regions 144A(R), 144A(G), and 144A(B), respectively, in which a plurality of pixels are arranged in a matrix. Hereinafter, the panel regions 144A(R), 144A(G), and 144A(B) will be collectively referred to as panel region 144A. The panel regions 144A(G) and 144A(B) are not shown in the drawings.

[0031] Image data is input to the light modulation device 142A from the image processing unit 130A. to is the driving voltage corresponding to the input image data but, The panel driver 146A applies a signal to each pixel in the panel area 144A. will be As a result, each pixel in panel region 144A is set to a light transmittance corresponding to the image data. When light emitted from light source 141A passes through liquid crystal panel 143A, the light is modulated for each pixel, and colored light corresponding to the image data is generated. The generated colored light is synthesized for each pixel by a color synthesis optical system (not shown) to become image light that represents a color image.

[0032] The light modulation element provided in the light modulation device 142A is not limited to a transmissive liquid crystal panel, but may be, for example, a reflective liquid crystal panel or a DMD (Digital Micromirror Device).

[0033] The optical unit 145A includes a projection lens (not shown) and projects the image light modulated by the light modulation device 142A onto the projection surface 10 in an enlarged form. As a result, an image corresponding to the image light is displayed on the projection surface 10.

[0034] The first control unit 150A is a computer device including a first storage unit 160A and a first processor 170A.

[0035] The first storage unit 160A includes, for example, a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores a control program 161 that controls the operation of the projector 100A and various setting information. Used This includes information on the number of projectors 100, their placement, and so on. The number information is information that indicates the number of projectors 100 that will participate in the tiling projection. The placement information is information that indicates the placement of each projector 100. In the present embodiment, the information indicates that the projector 100A is placed on the left side as viewed from the projection surface 10, and that the projector 100A displays an image in a projectable area 11, which is an area on the left side of the projection surface 10. The ROM also stores the pattern image 30 that the projector 100A displays on the projection surface 10. Details of the pattern image 30 will be described with reference to Fig. 9. The RAM is used as a calculation area for the first processor 170A.

[0036] The first processor 170A is an arithmetic processing device including a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The first processor 170A may be configured with a single processor or multiple processors. The first processor 170A may also be configured with an SoC integrated with part or all of the first storage unit 160A or other circuits. The first processor 170A may also be configured with a combination of a CPU that executes programs and a DSP (Digital Signal Processor) that executes predetermined arithmetic processing. Furthermore, all of the functions of the first processor 170A may be implemented in hardware, or may be configured using a programmable device.

[0037] [Configuration of information processing device] FIG. 4 is a block diagram showing the configuration of the information processing device 300. The configuration of the information processing device 300 will be described with reference to FIG. The information processing device 300 includes a second wireless I / F 310, a second wired I / F 320, a third wired I / F 330, a display unit 340, an operation unit 350, and a second control unit 360.

[0038] The second wireless I / F 310 is an interface that performs wireless communication with external devices including the projector 100. For example, the second wireless I / F 310 includes a wireless LAN card, performs wireless communication with external devices, and transmits and receives various information. The second wireless I / F 310 may be configured to include an interface circuit and a wireless antenna.

[0039] The second wired I / F 320 is communicatively connected to the camera 200 via the cable 3 and receives captured images transmitted from the camera 200. The second wired I / F 320 is provided with, for example, a terminal conforming to the USB standard, and an interface for data communication such as USB is used. The second wired I / F 320 may be configured to include a terminal or interface circuit conforming to other communication standards.

[0040] The third wired I / F 330 is communicably connected to the projector 100A via a cable 5, and transmits an image signal to the projector 100A. The third wired I / F 330 uses an interface that includes a terminal that complies with standards such as HDMI, DisplayPort, and USB Type-C. The third wired I / F 330 may be configured to include an interface circuit.

[0041] The display unit 340 includes a display panel 345 such as a liquid crystal panel or an organic EL (Electro-Luminescence) panel. The display unit 340, under the control of the second control unit 360, causes the display panel 345 to display a display screen.

[0042] The operation unit 350 includes input devices such as a mouse and a keyboard, and receives user operations. The operation unit 350 outputs an operation signal corresponding to the received operation to the second control unit 360. The operation unit 350 may also be configured with a touch sensor that detects a touch operation on the display panel 345 of the display unit 340. In this case, the operation unit 350 outputs to the second control unit 360 coordinate information indicating the position on the display panel 345 where the touch operation was detected.

[0043] The second control unit 360 is a computer device including a second storage unit 370 and a second processor 380 .

[0044] The second storage unit 370 includes, for example, a ROM and a RAM. The ROM stores a control program 371 that controls the operation of each unit of the information processing device 300, a content file 373, and various setting information. The content file 373 is a file that includes content such as moving images, still images, and documents. The RAM is used as a calculation area for the second processor 380. The second storage unit 370 may also include an auxiliary storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0045] The second processor 380 is an arithmetic processing device including a processor such as a CPU or an MPU. The second processor 380 may be configured with a single processor or multiple processors. The second processor 380 may also be configured as an SoC integrated with part or all of the second storage unit 370 or other circuits. The second processor 380 may also be configured as a combination of a CPU that executes programs and a DSP that executes predetermined arithmetic processing. Furthermore, all of the functions of the second processor 380 may be implemented in hardware, or may be configured using a programmable device.

[0046] [About tiling projection] FIG. 5 is a diagram showing the projection surface 10. As shown in FIG. Here, the areas of the projection surface 10 onto which the projectors 100A and 100B project the image light will be described. Projector 100A is thrown Photo surface 10 Image light that can be projected The maximum area of ​​the projection screen 10 is called the projectable area 11. The projectable area 11 is the area of ​​the projection surface 10 on which an image is displayed when the image is projected over the entire surface of the panel area 144A of the liquid crystal panel 143A. is thrown Photo surface 10 Image light that can be projected of maximumThis area is referred to as projectable area 13. Projectable area 13 is the area of ​​projection surface 10 on which an image is displayed when the image is displayed over the entire surface of panel area 144B of liquid crystal panel 143B. 1, projector 100A is disposed on the left side as viewed from the side of projection surface 10, and projector 100B is disposed on the right side as viewed from the side of projection surface 10. Therefore, projectable area 11 is the area on the left side as viewed from the side of projection surface 10, and projectable area 13 is the area on the right side as viewed from the side of projection surface 10.

[0047] The display system 1 of this embodiment causes the projectors 100A and 100B to perform tiling projection. Tiling projection is a projection method that uses multiple projectors 100 to display images on a projection surface 10, and combines the images displayed by each projector 100 on the projection surface 10 to display a single large-screen image.

[0048] In tiling projection, it is preferable that the projectors 100 are adjusted so that the images displayed by each projector 100 overlap. This is done to make the boundaries between images displayed on the projection surface 10 less noticeable. The area where the projectable area 11 and the projectable area 13 overlap is called an overlap area 15. In this embodiment, the overlap area 15 is formed when the right edge of the projectable area 11 and the left edge of the projectable area 13 overlap in the drawing.

[0049] Moreover, the area where the projectors 100A and 100B actually display images by tiling projection is called a tiling area 20. The tiling area 20 corresponds to the projection area of ​​the projection surface 10. If projector 100A displays an image in projectable area 11 and projector 100B displays an image in projectable area 13, the images displayed on projection surface 10 will not be combined to form a single large-screen image. For this reason, information processing device 300 generates parameters for projectors 100A and 100B to correct the range in which the image is displayed, the shape of the image, etc., and transmits the generated parameters to projectors 100A and 100B via wireless communication. Projectors 100A and 100B project images corrected according to the received parameters onto projection surface 10, thereby displaying the images in tiling area 20 on projection surface 10. The image displayed in tiling area 20 corresponds to the tiling image. The image corrected according to the received parameters and projected by projector 100A onto projection surface 10 corresponds to the first projected image. The image corrected according to the received parameters and projected by projector 100B onto projection surface 10 corresponds to the second projected image.

[0050] [Operation of information processing devices and projectors] FIG. 6 is a flowchart showing the operation of the information processing device 300. First, the operation of the information processing device 300 will be described with reference to the flowchart shown in FIG. The second control unit 360 of the information processing device 300 generates parameters (step SA1). The parameters generated by the second control unit 360 include three parameters: a parameter indicating the resolution of the tiling area 20, a parameter indicating the width of the overlap area 15, and a parameter for shape correction. The parameters generated by the second control unit 360 correspond to a first correction parameter and a second correction parameter. Details of step SA1 will be described in detail with reference to the flowchart in FIG. 8.

[0051] Next, the second control unit 360 transmits the generated parameters to the projectors 100A and 100B via the second wireless I / F 310 (step SA2).

[0052] Next, the second control unit 360 determines whether or not EDID (Extended Display Identification Data) has been received from the projector 100A via the third wired I / F 330 (step SA3). When the projector 100A receives the parameters from the information processing device 300, it stores the received parameters in the first storage unit 160A. Furthermore, the projector 100A acquires parameters indicating the resolution of the tiling area 20, and sets the acquired parameters indicating the resolution in the EDID. The projector 100A transmits the set EDID to the information processing device 300 via the first wired I / F 120A. If the second control unit 360 has not received the EDID (step SA3 / NO), it waits until it receives the EDID.

[0053] When the second control unit 360 receives the EDID (step SA3 / YES), it recognizes the projector 100A connected by the cable 5 as a display screen with the resolution set by the EDID.

[0054] Next, the second control unit 360 determines whether or not an instruction to play the content file 373 has been issued by the operation unit 350 (step SA4). If an instruction to play the content file 373 has not been issued (step SA4 / NO), the second control unit 360 waits until an instruction to play the content file 373 is issued.

[0055] When the second control unit 360 is instructed to play the content file 373 (step SA4 / YES), it acquires image data from the content file 373 and generates an image signal including the acquired image data. The second control unit 360 transmits the generated image signal to the projector 100A (step SA5). If the resolution of the image data included in the content file 373 differs from the display resolution of the projector 100A recognized by the EDID, the second control unit 360 converts the resolution of the image data to a resolution corresponding to the EDID. The second control unit 360 transmits an image signal including the image data with the converted resolution to the projector 100A.

[0056] Next, the second control unit 360 determines whether the reproduction of the content file 373 has ended or whether an instruction to end the reproduction has been received (step SA6). If the playback of the content file 373 has not finished or an instruction to finish playback has not been received (step SA6 / NO), the second control unit 360 waits until the playback of the content file 373 finishes or an instruction to finish playback is received. Furthermore, when the reproduction of the content file 373 is completed or an instruction to complete the reproduction is received (step SA6 / YES), the second control unit 360 completes the transmission of the image signal (step SA7).

[0057] FIG. 7 is a flowchart showing the operation of the projector 100A. Next, the operation of the projector 100A will be described with reference to the flowchart shown in FIG. The first control unit 150A determines whether or not a parameter has been received from the information processing device 300 (step SB1). If the parameter has not been received from the information processing device 300 (step SB1 / NO), the first control unit 150A waits until the parameter is received.

[0058] When the first control unit 150A receives the parameters (step SB1 / YES), it stores the received parameters in the first storage unit 160A. Next, the first control unit 150A acquires a parameter indicating the resolution of the tiling area 20 from the received parameters, and sets the acquired parameter indicating the resolution in the EDID (step SB2). The first control unit 150A transmits the set EDID to the information processing device 300 via the first wired I / F 120A (step SB3).

[0059] Next, the first control unit 150A determines the area in which the projector 100A is responsible for display, based on the received parameters (step SB4). The first control unit 150A controls the tiling projection. UsedThe first control unit 150A stores information such as the number of projectors 100 and arrangement information as setting information. Based on the setting information and the received parameters, the first control unit 150A determines the area in the tiling area 20 that the projector 100A is responsible for displaying.

[0060] Next, the first control unit 150A determines whether the first wired I / F 120A has received the image signal transmitted from the information processing device 300 (step SB5). If the first control unit 150A has not received the image signal (step SB5 / NO), the first control unit 150A waits until the image signal is received.

[0061] When the first wired I / F 120A receives the image signal (step SB5 / YES), the first control unit 150A transmits the received image signal to the subsequent projector 100B (step SB6).

[0062] Next, the projector 100A extracts the image data included in the image signal by the receiving circuit 123A of the first wired I / F 120A (step SB7). The extracted image data is output to the image processing unit 130A.

[0063] Image processing unit 130A cuts out image data corresponding to the assigned region determined in step SB4 from the input image data (step SB8). Next, image processing unit 130A performs transparency processing on the region of the cut-out image data that corresponds to overlap region 15 (step SB9). The transparency processing is processing that adjusts the brightness of the region of the image data that corresponds to overlap region 15.

[0064] Furthermore, image processing unit 130A corrects the shape of the image data that has been subjected to the transparency process based on the shape correction parameters received in step SB1 (step SB10). Image processing unit 130A outputs the image data whose shape has been corrected to image projection unit 140A.

[0065] Image projection unit 140A projects the input image data onto panel area 144A of liquid crystal panel 143A. Light emitted from light source 141A passes through panel area 144A of liquid crystal panel 143A, generating image light corresponding to the image data. The generated image light is projected onto projection surface 10 by optical unit 145A (step SB11).

[0066] Next, the first control unit 150A determines whether or not the reception of the image signal has finished (step SB12). If the reception of the image signal has not finished (step SB12 / NO), the first control unit 150A returns to the processing of step SB6. If the reception of the image signal has finished (step SB12 / YES), the first control unit 150A ends this processing flow.

[0067] FIG. 8 is a flowchart showing the details of step SA1. Next, details of step SA1, that is, the operation of the information processing device 300 to generate three parameters, a parameter indicating the resolution of the tiling area 20, a parameter indicating the width of the overlap area 15, and a parameter for shape correction, will be described.

[0068] First, the second control unit 360 transmits an instruction to the projector 100A to project the pattern image 30 (step SA101). In this embodiment, a case will be described in which the projectors 100A and 100B store the pattern image 30 in advance, but the second control unit 360 may transmit the pattern image 30 to the projectors 100A and 100B.

[0069] When the projector 100A receives an instruction to project the pattern image 30 from the information processing device 300, it displays the pattern image 30 over the entire surface of the panel area 144A and generates image light corresponding to the pattern image 30. The projector 100A projects the generated image light onto the projection surface 10 using the optical unit 145A. As a result, the pattern image 30 is displayed in the projectable area 11 of the projection surface 10. The pattern image 30 displayed in the projectable area 11 by the projector 100A corresponds to the first image.

[0070] FIG. 9 is a diagram showing an example of the pattern image 30 developed on the panel area 144A of the projector 100A. Hereinafter, the coordinates set in the panel area 144A will be referred to as the first coordinates. The upper left corner of the first coordinates will be referred to as the origin O, the horizontal axis as the G axis, and the vertical axis as the H axis. 9, the pattern image 30 is a pattern image in which first rectangular figures 31 and second rectangular figures 33, which have the same shape and size, are alternately arranged in the vertical and horizontal directions of the pattern image 30 in the panel area 144A. The first rectangular figure 31 is a black rectangle, and the second rectangular figure 33 is a white rectangle. The color of the first rectangular figure 31 is not limited to black, and the color of the second rectangular figure 33 is not limited to white. The colors of the first rectangular figure 31 and the second rectangular figure 33 may be different; for example, colors that are complementary on the color wheel may be used for the first rectangular figure 31 and the second rectangular figure 33.

[0071] Next, the second control unit 360 transmits an image capture instruction to the camera 200 (step SA102). When the camera 200 receives the image capture instruction, it captures an image and generates a captured image. The generated captured image is called a first captured image. The first captured image includes a pattern image in the projectable area 11. 30 The camera 200 captures an image of the projection surface 10 on which the image is displayed. The camera 200 transmits the generated first captured image to the information processing device 300.

[0072] The second control unit 360 determines whether or not the first captured image has been received from the information processing device 300 (step SA103). If the first captured image has not been received (step SA103 / NO), the second control unit 360 waits until the first captured image is received.

[0073] When the second control unit 360 receives the first captured image (step SA103 / YES), it stores the received first captured image in the second storage unit 370. Next, the second control unit 360 transmits an instruction to the projector 100B to project the pattern image 30 (step SA104), and then transmits an image capture instruction to the camera 200 (step SA105).

[0074] The projector 100B displays the pattern image 30 in the projectable area 13 of the projection surface 10, and the camera 200 captures the image to generate a captured image. The generated captured image is called a second captured image. The second captured image displays the pattern image 30 in the projectable area 13. 30 The camera 200 captures the projection surface 10 on which the pattern image 30 is displayed. The camera 200 transmits the generated second captured image to the information processing device 300. The pattern image 30 displayed in the projectable area 13 by the projector 100B corresponds to the second image.

[0075] The second control unit 360 determines whether or not the second captured image has been received from the information processing device 300 (step SA106). If the second captured image has not been received (step SA106 / NO), the second control unit 360 waits until the second captured image is received. When the second control unit 360 receives the second captured image (step SA106 / YES), the second control unit 360 causes the second storage unit 370 to store the received second captured image.

[0076] Next, the second control unit 360 analyzes the first captured image and detects the coordinates of the four vertices that are the four corners of the pattern image 30 (step SA107). line The first rectangular figure 31 and the second rectangular figure 33 adjacent to each other and one of these figures lineThe coordinates of the intersections of the four vertices of the second rectangular graphic 33 and the first rectangular graphic 31, which are adjacent below, are detected. Here, the detected coordinates are the coordinates of the second coordinates. The pattern image 30 is arranged at the four corners and is the same line The first rectangular figure 31 and the second rectangular figure 33 adjacent to each other and one of these figures line The second rectangular graphic 33 and the first rectangular graphic 31, which are adjacent to each other below, correspond to a predetermined graphic.

[0077] The second coordinates are coordinates set in the captured image of the camera 200, i.e., the first captured image and the second captured image. The second coordinates are coordinates with the upper left corner of the captured image as the origin O, the horizontal axis as the J axis, and the vertical axis as the K axis. The capturing position of the camera 200 is fixed, and the camera 200 does not change settings such as the angle of view when capturing the first captured image and the second captured image. Therefore, the same position in the first captured image and the second captured image is associated with the same coordinate in the second coordinates.

[0078] Of the coordinates of the detected intersections, the second control unit 360 detects four intersections where the J-axis and K-axis values ​​are (minimum, minimum), (maximum, minimum), (minimum, maximum), and (maximum, maximum). The second control unit 360 detects the four vertices of the pattern image 30 based on the coordinates of these detected four intersections in the second coordinate system.

[0079] Similarly, the second control unit 360 analyzes the second captured image to detect the coordinates of the four vertices of the pattern image 30 (step SA107). The second control unit 360 obtains the coordinate values ​​of the second coordinates indicating the positions of the four vertices of the pattern image 30 detected from the second captured image. The four vertices of the pattern image 30 captured in the first captured image and the four vertices of the pattern image 30 captured in the second captured image may be designated by the user operating the operation unit 350 or by the user's touch operation.

[0080] FIG. 10 is a diagram showing second coordinates obtained by plotting four vertices of the pattern image 30 detected from the first captured image and the second captured image. The four vertices of the pattern image 30 detected from the first captured image are referred to as vertices a1, a2, a3, and a4. These four vertices a1, a2, a3, and a4 are collectively referred to as a first vertex group. The four vertices of the pattern image 30 detected from the second captured image are referred to as vertices b1, b2, b3, and b4. These four vertices b1, b2, b3, and b4 are collectively referred to as a second vertex group. The vertex a1 is the vertex located at the upper left of the pattern image 30 when viewed from the drawing. The vertex a2 is the vertex located at the top right of the pattern image 30 when viewed from the drawing. The vertex a3 is located at the bottom left of the pattern image 30 when viewed from the drawing. The vertex a4 is located at the bottom right of the pattern image 30 when viewed from the drawing. The vertex b1 is the vertex located at the upper left of the pattern image 30 when viewed from the drawing. The vertex b2 is the vertex located at the top right of the pattern image 30 in the drawing view. The vertex b3 is located at the bottom left of the pattern image 30 when viewed from the drawing. The vertex b4 is located at the bottom right of the pattern image 30 when viewed from the drawing. Here, the view from the drawing in FIG. 10 indicates a state in which the origin O is located at the top left. The second control unit 360 causes the second storage unit 370 to store the coordinates of the first vertex group of the pattern image 30 detected from the first captured image. The second control unit 360 also causes the second storage unit 370 to store the coordinates of the second vertex group of the pattern image 30 detected from the second captured image.

[0081] Next, the second control unit 360 classifies the first group of vertices a1, a2, a3, and a4, which are the four vertices of the pattern image 30 detected from the first captured image, into two vertices located on the upper side of the pattern image 30 and two vertices located on the lower side (step SA108). The second control unit 360 compares the K coordinate values ​​of the first vertex group a1, a2, a3, and a4, and determines that the two vertices a1 and a2 with the smaller K coordinate values ​​are the vertices located on the upper side.

[0082] Similarly, the second control unit 360 classifies the second group of vertices b1, b2, b3, and b4, which are the four vertices of the pattern image 30 detected from the second captured image, into two vertices located on the upper side of the pattern image 30 and two vertices located on the lower side (step SA109). The second control unit 360 compares the K coordinate values ​​of the second group of vertices b1, b2, b3, and b4, and determines that the two vertices b1 and b2 with the smaller K coordinate values ​​are the vertices located on the upper side.

[0083] FIG. 11 is a diagram showing a state in which two straight lines L1 and L2 are set on the second coordinate system. Next, the second control unit 360 sets a straight line L1 at the second coordinate and calculates the slope r1 of the straight line L1 to determine the upper side of the tiling area 20 to be used for tiling projection from the area determined by the first group of vertices and the second group of vertices (step SA110).

[0084] The second control unit 360 sets a line L1 that passes through any two of the four vertices a1, a2, b1, and b2 located on the top side. In this embodiment, the line L1 is set so as to pass through the vertex a1 at the left end of the pattern image 30 detected from the first captured image and the vertex b2 at the right end of the pattern image 30 detected from the second captured image. The second control unit 360 calculates the slope r1 of the line L1 and stores the calculated slope r1 in the second storage unit 370.

[0085] Similarly, the second control unit 360 sets a straight line L2 at the second coordinate and calculates the slope r2 of the straight line L2 to determine the bottom side of the tiling area 20 to be used for tiling projection within the area determined by the first group of vertices and the second group of vertices (step SA111).

[0086] The second control unit 360 sets a line passing through any two of the four vertices a3, a4, b3, and b4 located on the bottom side as line L2. In this embodiment, line L2 is set so as to pass through vertex a3 at the left end of the pattern image 30 detected from the second captured image and vertex b4 at the right end of the pattern image 30 detected from the second captured image. The second control unit 360 calculates a slope r2 of line L2 and stores the calculated slope r2 in the second storage unit 370.

[0087] FIG. 12 is a diagram showing a state in which two straight lines L1 and L2 set on the second coordinate system are translated. Next, the second control unit 360 translates the straight lines L1 and L2 (step SA112). The second control unit 360 compares the K coordinate values ​​of the vertices a1 and a2 located on the upper side of the first vertex group with the vertices b1 and b2 located on the upper side of the second vertex group, and determines the vertex with the largest K coordinate value, i.e., the K Axis arrow direction 12, the vertex b1 is selected. The second control unit 360 moves the straight line L1 so that it passes through the vertex b1.

[0088] The second control unit 360 also compares the K coordinate values ​​of the vertices a3 and a4 located on the lower side of the first vertex group with the vertices b3 and b4 located on the lower side of the second vertex group, and determines the vertex with the smallest K coordinate value, i.e., the K In the direction of the arrow on the shaft The topmost vertex is selected. In the example shown in Fig. 12, the vertex a4 is selected. The second control unit 360 moves the straight line L2 so that it passes through the vertex a4.

[0089] FIG. 13 is a diagram showing the intersections of the straight lines L1 and L2 with the pattern image 30. As shown in FIG. Next, the second control unit 360 determines the coordinates of intersections c1 and c2 between the straight line L1 and the pattern image 30 (step SA113). The second control unit 360 sets intersection c1 as the intersection between the line segment defined by the vertices a1 and a3 and the straight line L1. The second control unit 360 also sets intersection c2 as the intersection between the line segment defined by the vertices b2 and b4 and the straight line L1.

[0090] Next, the second control unit 360 determines the coordinates of intersections c3 and c4 between the straight line L2 and the pattern image 30 (step SA114). The second control unit 360 sets intersection c3 as the intersection between the line segment defined by the vertices a1 and a3 and the straight line L2. The second control unit 360 also sets intersection c4 as the intersection between the line segment defined by the vertices b2 and b4 and the straight line L2.

[0091] Next, the second control unit 360 calculates the line of projective transformation. Column H The second control unit 360 calculates the coordinates of the four vertices a1, a2, a3, and a4 of the first vertex group and the coordinates of the four vertices of the pattern image 30 developed on the liquid crystal panel 143A (step SA115). Column H The coordinates of the four vertices of the first vertex group are coordinates on the second coordinate system, and the coordinates of the four vertices of the pattern image 30 expanded in the panel area 144A are coordinates on the first coordinate system. The second control unit 360 calculates the coordinates of the four vertices a1, a2, a3, and a4 of the first vertex group as the coordinates on the first coordinate system. 1 coordinate Nopa A line of projective transformation that transforms the four vertices of the turn image 30 Column H The second control unit 360 calculates the matrix of the calculated projective transformation. Column H 1 is stored in the second storage unit 370. In step SA115, the second control unit 360 may calculate a projective transformation matrix H3 that transforms the coordinates of the four vertices b1, b2, b3, and b4 of the second vertex group into the four vertices of the pattern image 30 whose coordinates are set in the panel area 144B, based on the coordinates of the four vertices b1, b2, b3, and b4 of the second vertex group and the coordinates of the four vertices of the pattern image 30 developed on the liquid crystal panel 143B, instead of the projective transformation matrix H1. Alternatively, the second control unit 360 may calculate the projective transformation matrix H1 and the projective transformation matrix H3.

[0092] Next, the second control unit 360 calculates the matrix of the calculated projective transformation. Column H 1 to perform projective transformation on the intersection points c1, c2, c3, and c4 (step SA116). Next, the second control unit 360 calculates the resolution of the tiling area 20 based on the coordinates of the intersection points c1, c2, c3, and c4 after the projective transformation. In step SA116, the second control unit 360 may perform projective transformation on the intersection points c1, c2, c3, and c4 using the calculated projective transformation matrix H3. Alternatively, the second control unit 360 may perform projective transformation on the intersection points c1, c2, c3, and c4 using the projective transformation matrix H1 and the projective transformation matrix H3. In other words, the projective transformation matrices used when projectively transforming the intersection points c1, c2, c3, and c4 may be appropriately selected depending on the purpose.

[0093] Fig. 14 is a diagram showing the projective transformation from the second coordinate system to the first coordinate system. In particular, Fig. 14 is a diagram showing four intersection points c1, c2, c3, and c4 on the second coordinate system and the coordinates on the first coordinate system after the projective transformation of these four intersection points c1, c2, c3, and c4. The position of intersection c1 after the projective transformation is denoted as d1, the position of intersection c2 after the projective transformation is denoted as point d2, the position of intersection c3 after the projective transformation is denoted as point d3, and the position of intersection c4 after the projective transformation is denoted as point d4.

[0094] Next, the second control unit 360 determines the midpoint between points d1 and d2 after the projective transformation as midpoint e1, and the midpoint between points d3 and d4 after the projective transformation as midpoint e2. The second control unit 360 also determines the midpoint between points d1 and d3 after the projective transformation as midpoint e3, and the midpoint between points d2 and d4 after the projective transformation as midpoint e4.

[0095] Next, the second control unit 360 calculates the resolution of the tiling area 20 (step SA117). The second control unit 360 calculates the distance of the line segment D1 connecting the midpoint e1 and the midpoint e2, and acquires the resolution of the line segment D1 corresponding to the calculated distance. The resolution of the line segment D1 corresponds to the vertical resolution of the tiling area 20 and the resolution of the projection area in the second direction. The first coordinates are coordinates set in the panel area 144A of the liquid crystal panel 143A, and the resolution of the panel area 144A is known. Therefore, the second control unit 360 can acquire the resolution based on the coordinate values ​​of the first coordinates. Similarly, the second control unit 360 calculates the distance of the line segment D2 connecting the midpoints e3 and e4, and acquires the resolution of the line segment D2 corresponding to the calculated distance. The line segments D1 and D2 are perpendicular to each other. The resolution of the line segment D2 corresponds to the horizontal resolution of the tiling area 20 and the first direction resolution of the projection area. The resolution of the tiling area 20 is indicated by the resolution of the line segment D1 and the resolution of the line segment D2.

[0096] Next, the second control unit 360 generates parameters for shape correction (step SA118). The second control unit 360 Based on the projective transformation matrix H1, A parameter for moving the vertex a1 shown in FIG. 13 to the position of the intersection c1 and a parameter for moving the vertex b2 to the position of the intersection c2 are generated as shape correction parameters. In step SA118, the second control unit 360 may generate the parameters for the shape correction based on the projective transformation matrix H3. Alternatively, the second control unit 360 may generate the parameters for the shape correction based on the projective transformation matrix H1 and the projective transformation matrix H3.

[0097] Fig. 15 is a diagram showing the projective transformation from the second coordinate system to the third coordinate system, particularly showing the state in which intersection points c1, c2, c3, and c4 on the second coordinate system are projectively transformed into the third coordinate system. First, the second control unit 360 calculates a projection transformation line for projecting the intersection points c1, c2, c3, and c4 of the first coordinate system onto four points on the third coordinate system. Column H 2 is found (step SA119). The third coordinates are coordinates set in an image supplied from the information processing device 300 to the projector 100, with the upper left corner of the image being the origin O, the horizontal axis of the third coordinates being the M axis, and the vertical axis being the N axis.

[0098] Furthermore, the four points of the third coordinate are set based on the resolution of the image indicated by the image data supplied from the information processing device 300 to the projector 100. For example, the points after projective transformation of the intersections c1, c2, c3, and c4 are defined as points f1, f2, f3, and f4, respectively. Also, assume that the image resolution is 3840 x 2160. In this case, the coordinates of point f1 are (0, 0), the coordinates of point f2 are (3840, 0), the coordinates of point f3 are (0, 2160), and the coordinates of point f4 are (3840, 2160). Here, the image resolution matches the resolution of the tiling area 20. The image resolution may be arbitrarily changeable by user settings.

[0099] Fig. 16 is a diagram showing the projective transformation from the second coordinate system to the third coordinate system, particularly showing the state after the vertices a2, a4, b1, and b3 on the second coordinate system are projectively transformed to the third coordinate system. Next, the second control unit 360 calculates the calculated row Column H 2, the vertices a2, a4, b1 and b3 are projectively transformed (step SA120). The position of vertex b1 after the projective transformation is denoted as point g1, the position of vertex a2 after the projective transformation is denoted as point g2, the position of vertex b3 after the projective transformation is denoted as point g3, and the position of vertex a4 after the projective transformation is denoted as point g4.

[0100] Next, the second control unit 360 calculates a parameter indicating the width of the overlapping region 15 (step SA121). The second control unit 360 calculates the distance on the M axis between points g1 and g2, which are obtained by projectively transforming vertices b1 and a2, which belong to the first vertex group, and the distance on the M axis between points g3 and g4, which are obtained by projectively transforming vertices b3 and a4, which belong to the second vertex group. The distance on the M axis between points g1 and g2 is called distance D3, and the distance on the M axis between points g3 and g4 is called distance D4. The second control unit 360 selects the shorter distance D3 from the distances D3 and D4 as the width of the overlapping area 15. As described above, the resolution of the tiling area 20 is known, so it is possible to obtain the resolution based on the distance on the third coordinate system. The second control unit 360 stores a parameter indicating the calculated width of the overlapping area 15 in terms of resolution in the second storage unit 370.

[0101] [Variation 1] In the above-described embodiment, the resolution of the line segment D1 and the resolution of the line segment D2 are transmitted as parameters indicating the resolution of the tiling area 20 to the projector 100A. In Modification 1, based on the calculated resolution of line segment D1 and the resolution of line segment D2, an arbitrary resolution conforming to the specifications of information processing device 300 and projector 100 is set as the resolution of tiling area 20. Second control unit 360 transmits the set resolution as a parameter to projector 100A.

[0102] First, the second control unit 360 calculates the aspect ratio of the resolution of the tiling area 20 indicated by the calculated resolution of the line segment D1 and the resolution of the line segment D2. Assume that the resolution of line segment D2, which is the resolution in the width direction of tiling area 20, is Wt, and the resolution of line segment D1, which is the resolution in the height direction of tiling area 20, is Ht. The width direction is the direction of D2 shown in FIG. 14, and the height direction is the direction of D1 shown in FIG. 14. The aspect ratio is Wt / Ht.

[0103] Next, the second control unit 360 calculates the resolution based on the aspect ratio and the specifications set in the information processing device 300 and the projector 100. For example, it is assumed that the resolution that can be set in the projector 100A is any even number in the width direction, and a fixed value of 1080 for full HD in the height direction. 1080 for full HD, which is the resolution in the height direction, is an example of a preset resolution. The resolution in the height direction is not limited to 1080 for full HD, and may be, for example, 2160 for 4K, or any resolution may be specified by the user. When specifying a resolution from the user, it is preferable that it is an even number. The preset resolution may also be the resolution in the width direction. Here, if the resolution in the width direction is Wd and the resolution in the height direction is Hd, then Wd = aspect ratio × Hd = aspect ratio × 1080 The Wd and Hd that satisfy the above condition are set as the resolution of the tiling area 20, and the set resolutions Wd and Hd are transmitted to the projector 100A as parameters.

[0104] [Variation 2] In the second modification, a resolution selected from the resolutions that can be set for the projector 100A and the projector 100B is set as the resolution of the tiling area 20. The second control unit 360 transmits the set resolution as a parameter to the projector 100A. First, the second control unit 360 acquires, from the projector 100A, list information of resolutions that can be set for the projector 100A. The second control unit 360 also acquires, from the projector 100B, list information of resolutions that can be set for the projector 100B. The list information acquired from the projector 100A is referred to as list information A, and the list information acquired from the projector 100B is referred to as list information B.

[0105] Next, the second control unit 360 compares the list information A with the list information B, and selects a resolution that is common to both the list information A and the list information B. The selected resolutions are called a common resolution group.

[0106] Next, the second control unit 360 calculates the aspect ratios of all the resolutions included in the common resolution group, and also calculates the aspect ratio of the resolution of the tiling area 20 indicated by the resolution of the line segment D1 and the resolution of the line segment D2, in the same manner as in the first modification. The aspect ratios of all resolutions in the common resolution group are vinegar It's called the aspect ratio. The aspect ratio calculated based on the resolution of the tiling area 20 is called the tiling aspect ratio.

[0107] Next, the second control unit 360 calculates the absolute value of the difference between each of the common aspect ratios and the tiling aspect ratio. The second control unit 360 selects the common aspect ratio whose absolute value of the difference between the common aspect ratio and the tiling aspect ratio is the smallest. The common aspect ratio selected here may be one or more. The selected common aspect ratio corresponds to the selected aspect ratio.

[0108] Next, the second control unit 360 acquires a common resolution corresponding to the selected common aspect ratio and calculates the number of pixels of the acquired common resolution by multiplying the resolution in the width direction and the resolution in the height direction of the common resolution.

[0109] Next, the second control unit 360 calculates the number of pixels in the tiling area 20. This number of pixels is found by multiplying the resolution of the line segment D2, which is the resolution in the width direction of the tiling area 20, by the resolution of the line segment D1, which is the resolution in the height direction.

[0110] Next, the second control unit 360 selects the number of pixels of the common resolution that is closest to the calculated number of pixels of the tiling area 20. The second control unit 360 selects the common resolution for which the absolute value of the difference between the number of pixels of the tiling area 20 and the number of pixels of the common resolution is smallest. The second control unit 360 sets the selected common resolution as the resolution of the tiling area 20, and transmits the set common resolution to the projector 100A as a parameter.

[0111] Furthermore, the second control unit 360 may generate a first group of aspect ratios that are aspect ratios that can be set in the projector 100A, based on the resolutions registered in the list information A. Furthermore, the second control unit 360 may generate a second group of aspect ratios that are aspect ratios that can be set in the projector 100B, based on the resolutions registered in the list information B. The number of aspect ratios registered in the first aspect ratio group and the second aspect ratio group may be one or more.

[0112] Next, the second control unit 360 determines the aspect ratios common to the first aspect ratio group and the second aspect ratio group as common aspect ratios. vinegar The ratios are obtained as a set of common vinegar The aspect ratio group may be one aspect ratio or multiple aspect ratios. vinegar The aspect ratios registered in the aspect ratio group are called common aspect ratios.

[0113] Next, the second control unit 360 vinegar The second control unit 360 calculates the absolute value of the difference between each of the common aspect ratios included in the group of aspect ratios and the tiling aspect ratio. The second control unit 360 selects the common aspect ratio with the smallest absolute value of the difference between the common aspect ratio and the tiling aspect ratio. The common aspect ratio selected here may be one or more. The selected common aspect ratio corresponds to the selected aspect ratio.

[0114] Next, the second control unit 360 acquires a common resolution corresponding to the selected common aspect ratio and calculates the number of pixels of the acquired common resolution. Next, the second control unit 360 calculates the number of pixels of the tiling area 20. This number of pixels is found by multiplying the resolution in the width direction and the resolution in the height direction of the tiling area 20.

[0115] Summary of this disclosure A summary of this disclosure is provided below. (Appendix 1) acquiring a first captured image obtained by capturing an image of a projection surface onto which a first image is projected by a first projector; acquiring a second captured image obtained by capturing an image of the projection surface onto which the second image is projected by the second projector; When a tiling image is displayed in a projection area of ​​the projection surface by a first projection image projected onto the projection surface by the first projector and a second projection image projected onto the projection surface by the second projector, information indicating a resolution of the projection area is acquired based on the first captured image and the second captured image; acquiring a first correction parameter for correcting an image projected by the first projector based on the first captured image and the second captured image; acquiring second correction parameters for correcting the image projected by the second projector based on the first captured image and the second captured image; projecting, by the first projector, the first projection image generated based on an input image, the information indicating the resolution, and the first correction parameter onto the projection surface; projecting, by the second projector, the second projection image generated based on the input image, the information indicating the resolution, and the second correction parameter onto the projection surface; A projection method including:

[0116] According to this, in tiling projection in which a portion of an image projected by a first projector and a portion of an image projected by a second projector are superimposed, the resolution of the projection area of ​​the projection surface on which the image is displayed is determined based on the first captured image and the second captured image. Therefore, the projection area in which an image is displayed by tiling projection can be determined with high precision, and the precision of tiling projection can be improved. Furthermore, the first correction parameter and the second correction parameter are acquired based on the first captured image and the second captured image. Therefore, the first projection image corresponding to the projection area can be generated with high accuracy using the first correction parameter. Furthermore, the second correction parameter can be used to generate with high accuracy the second projection image corresponding to the projection area.

[0117] (Appendix 2) Obtaining information indicating a resolution of the projection area based on the first captured image and the second captured image includes: acquiring positions of four corners of the first image from the first captured image; acquiring positions of four corners of the second image from the second captured image; determining the projection area based on positions of four corners of the first image and positions of four corners of the second image; Obtaining a resolution of the projection area; 2. The projection method of claim 1, including:

[0118] According to this, the projection area to be used for tiling projection is determined based on the positions of the four corners of the image included in the first captured image and the positions of the four corners of the image included in the second captured image, which makes it possible to accurately determine the projection area to be used for tiling projection.

[0119] (Appendix 3) Obtaining the resolution of the projection area includes: Obtaining a resolution of the projection area in a first direction; acquiring a resolution in a second direction of the projection area that is orthogonal to the first direction; 3. The projection method of claim 2, including:

[0120] This makes it possible to acquire the resolution of the projection area in a first direction and in a second direction perpendicular to the first direction, thereby enabling the resolution of the projection area used in tiling projection to be defined with high precision.

[0121] (Appendix 4) Obtaining the resolution of the projection area includes: obtaining an even number of resolutions as the resolution in the first direction; 4. The projection method of claim 3,

[0122] This allows an even-numbered resolution to be acquired as the resolution in the first direction, which allows the resolution in the first direction to be set to a resolution that can be displayed by the projector.

[0123] (Appendix 5) Obtaining the resolution in the first direction includes: obtaining an aspect ratio of the projection area based on a resolution of the projection area; acquiring a preset resolution as the resolution in the second direction; obtaining a resolution in the first direction based on the aspect ratio and the preset resolution; 5. The projection method according to claim 3 or 4,

[0124] This allows the resolution in the first direction to be acquired based on the aspect ratio of the projection area when the resolution in the second direction is a preset resolution, and therefore the resolution in the first direction can be set to an appropriate resolution depending on the resolution in the second direction.

[0125] (Appendix 6) Obtaining the resolution of the projection area includes: acquiring information on a first set of aspect ratios that can be set to the first projector; acquiring information on a second group of aspect ratios that can be set to the second projector; acquiring aspect ratios commonly included in the first aspect ratio group and the second aspect ratio group as a common aspect ratio group; acquiring, as a selected aspect ratio, an aspect ratio that has the smallest difference from an aspect ratio calculated based on the resolution of the projection area, from among the aspect ratios included in the common aspect ratio group; obtaining a resolution in the first direction and a resolution in the second direction based on the selected aspect ratio; 6. The projection method according to any one of Supplementary Notes 3 to 5, comprising:

[0126] According to this, it is possible to select, as the selected aspect ratio, an aspect ratio that can be set commonly to the first projector and the second projector and that has the smallest difference from the aspect ratio calculated based on the resolution of the projection area. Also, it is possible to set the resolutions in the first and second directions of the projection area based on the selected aspect ratio. Therefore, it is possible to set the resolutions in the first and second directions that are suitable for the first projector and the second projector.

[0127] (Appendix 7) Obtaining the first direction resolution and the second direction resolution based on the selected aspect ratio includes: Obtaining the number of pixels of the projection area based on the resolution of the projection area; obtaining a plurality of resolutions that have the selected aspect ratio and that are settable for the first projector and the second projector; acquiring the number of pixels for each of the plurality of resolutions; selecting a resolution from the number of pixels of the plurality of resolutions that has the smallest difference from the number of pixels of the projection area; acquiring the resolution in the first direction and the resolution in the second direction based on a resolution selected as a resolution having the smallest difference from the number of pixels of the projection area; 7. The projection method of claim 6,

[0128] This makes it possible to acquire the resolution in the first direction and the resolution in the second direction based on the resolution that has the selected aspect ratio, is settable for the first projector and the second projector, and has the smallest difference from the number of pixels in the projection area, and therefore makes it possible to set appropriate resolutions in the first direction and the second direction according to the resolution of the projection area.

[0129] (Appendix 8) The first projector storing information indicating the resolution and the first correction parameter; When the first projector is connected by wire to a control device that supplies the input image to the first projector, the first projector transmits EDID (Extended Display Identification Data) including information indicating a resolution of the projection area to the control device; 8. The projection method according to any one of Supplementary Notes 1 to 7,

[0130] This allows the control device to be notified of the resolution of the projection area, allowing the control device to obtain information indicating the resolution of the projection area.

[0131] (Appendix 9) The control device acquiring information indicating a resolution of the projection area, the first correction parameter, and the second correction parameter; transmitting information indicating a resolution of the projection area and the first correction parameter to the first projector; transmitting information indicating a resolution of the projection area and the second correction parameter to the second projector; 9. The projection method of claim 8,

[0132] According to this, information indicating the resolution of the projection area and the first correction parameter are transmitted to the first projector, and information indicating the resolution of the projection area and the second correction parameter are transmitted to the second projector. Therefore, the first projector can be caused to generate a first projection image, and the second projector can be caused to generate a second projection image.

[0133] (Appendix 10) the first image is an image including a predetermined graphic at positions corresponding to at least four corners of the first image, The second image is an image including a predetermined figure at positions corresponding to at least four corners of the second image. 10. A projection method according to any one of claims 1 to 9.

[0134] According to this, the first image includes a predetermined graphic at positions corresponding to the four corners, and the second image includes a predetermined graphic at positions corresponding to the four corners, which makes it easy to detect the positions of the four corners of the first image and the second image.

[0135] (Appendix 11) an imaging device that acquires a first captured image obtained by capturing an image of a projection surface onto which a first image is projected by a first projector, and a second captured image obtained by capturing an image of the projection surface onto which a second image is projected by a second projector; When a tiling image is displayed in a projection area of ​​the projection surface by a first projection image projected onto the projection surface by the first projector and a second projection image projected onto the projection surface by the second projector, information indicating a resolution of the projection area is acquired based on the first captured image and the second captured image; acquiring a first correction parameter for correcting an image projected by the first projector based on the first captured image and the second captured image; a control device that executes acquiring second correction parameters for correcting the image projected by the second projector based on the first captured image and the second captured image; the first projector that projects a first projection image onto the projection surface, the first projection image being generated based on an input image, the information indicating the resolution, and the first correction parameter; the second projector that projects a second projection image that is generated based on the input image, the information indicating the resolution, and the second correction parameter; A projection system comprising:

[0136] According to this configuration, in tiling projection in which a portion of an image projected by a first projector and a portion of an image projected by a second projector are superimposed, the resolution of the projection area of ​​the projection surface on which the image is displayed is determined based on the first captured image and the second captured image. Therefore, the projection area in which an image is displayed by tiling projection can be determined with high precision, and the precision of tiling projection can be improved. In addition, the first correction parameter and the second correction parameter are obtained based on the first captured image and the second captured image. Therefore, a first projection image corresponding to the projection area can be generated with high accuracy using the first correction parameter, and a second projection image corresponding to the projection area can be generated with high accuracy using the second correction parameter.

[0137] (Appendix 12) an imaging device that acquires a first captured image obtained by capturing an image of a projection surface onto which a first image is projected by a first projector, and a second captured image obtained by capturing an image of the projection surface onto which a second image is projected by a second projector; When a tiling image is displayed in a projection area of ​​the projection surface by a first projection image projected onto the projection surface by the first projector and a second projection image projected onto the projection surface by the second projector, information indicating a resolution of the projection area is acquired based on the first captured image and the second captured image; acquiring a first correction parameter for correcting an image projected by the first projector based on the first captured image and the second captured image; acquiring second correction parameters for correcting the image projected by the second projector based on the first captured image and the second captured image; transmitting information indicating a resolution of the projection area and the first correction parameter to the first projector; transmitting information indicating a resolution of the projection area and the second correction parameter to the second projector; a control device that executes the When connected to the control device, transmitting an EDID to the control device, the EDID including information indicating the resolution; the first projector that projects a first projection image that is generated based on an input image, information indicating the resolution, and the first correction parameter; a second projector configured to project a second projection image onto the projection surface, the second projection image being generated based on the input image, the information indicating the resolution, and the second correction parameter;

[0138] According to this configuration, in tiling projection in which a portion of an image projected by a first projector and a portion of an image projected by a second projector are superimposed, the resolution of the projection area of ​​the projection surface on which the image is displayed is determined based on the first captured image and the second captured image. Therefore, the projection area in which an image is displayed by tiling projection can be determined with high precision, and the precision of tiling projection can be improved. In addition, the first correction parameter and the second correction parameter are obtained based on the first captured image and the second captured image. Therefore, a first projection image corresponding to the projection area can be generated with high accuracy using the first correction parameter, and a second projection image corresponding to the projection area can be generated with high accuracy using the second correction parameter. Furthermore, when the control device is connected to the first projector, the first projector transmits EDID including information indicating the resolution to the control device. Therefore, it is possible to make the control device recognize the first projector as a display device and notify the control device of the resolution of the image displayed by the first projector.

[0139] The above-described embodiment is a preferred embodiment of the present invention. However, the present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the gist of the present invention. For example, in the above-described embodiment, the camera 200 is provided externally to the information processing device 300 and the projector 100, but the information processing device 300 or the projector 100 may be configured to include the camera 200.

[0140] Furthermore, in the above-described embodiment, the case has been described in which the information processing device 300 generates parameters such as the resolution of the tiling area 20, the width of the overlapping area 15, and shape correction, but these parameters may also be generated by the camera 200. Furthermore, these parameters may also be generated by the projector 100A or 100B.

[0141] Furthermore, if the calculated resolution of the tiling area 20 is a resolution that cannot be recognized as an EDID value, the second control unit 360 may change the resolution of the tiling area 20 to a value that can be recognized as an EDID value. For example, depending on the specifications, it may not be possible to set an odd number for the display resolution. For example, if at least one of the calculated width and height resolutions of the tiling area 20 is odd, the second control unit 360 may correct the odd number to an even number.

[0142] Furthermore, in the above-described embodiment, the light modulation device 142A is illustrated as including the liquid crystal panel 143A, but the liquid crystal panel 143A may be a transmissive liquid crystal panel or a reflective liquid crystal panel. Furthermore, the light modulation device 142A may be configured using a digital mirror device instead of the liquid crystal panel 143A. Furthermore, the light modulation device 142A may be configured by combining a digital mirror device with a color wheel. Furthermore, the light modulation device 142A may employ a configuration capable of modulating light emitted from a light source, other than the liquid crystal panel 143A and the digital mirror device.

[0143] 2 and 3 show functional configurations of the projector 100A, and the specific implementation form is not particularly limited. In other words, it is not necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which a single processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiments may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of the other units of the projector may also be changed as desired without departing from the spirit of the present invention.

[0144] Furthermore, the functional units of the information processing device 300 shown in FIG. 4 represent functional configurations, and the specific implementation form is not particularly limited. In other words, it is not necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which a single processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiments may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of the other units of the projector may also be changed as desired without departing from the spirit of the present invention.

[0145] 6 and 8 are divided according to the main processing content in order to facilitate understanding of the processing of the information processing device 300. The present invention is not limited by the manner in which the processing units are divided or the names of the processing units shown in the flowcharts of FIGS. 6 and 8. Furthermore, the processing of the information processing device 300 can be divided into more processing units according to the processing content, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the drawings.

[0146] Furthermore, the processing units in the flowchart shown in Fig. 7 are divided according to the main processing content in order to make the processing of projector 100A easier to understand. The present invention is not limited by the manner in which the processing units shown in the flowchart in Fig. 7 are divided or the names of the processing units. Furthermore, the processing of projector 100A can be divided into more processing units according to the processing content, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowchart is not limited to the example shown in the figure.

[0147] Furthermore, when the projection method is implemented by a computer included in the information processing device 300, the program executed by the computer can be configured as a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specific examples include portable or fixed recording media such as flexible disks, HDDs (Hard Disk Drives), CD-ROMs, DVDs, Blu-ray Discs, magneto-optical disks, flash memories, and card-type recording media. The recording medium can also be a non-volatile storage device such as RAM, ROM, or HDD, which is an internal storage device included in the server device. Blu-ray is a registered trademark. [Explanation of symbols]

[0148] 1...projection system, 3...cable, 5...cable, 7...wireless router, 9...wireless network, 10...projection surface, 11...projectable area, 13...projectable area, 15...superimposing area, 20...tiling area, 30...pattern image, 31...first rectangular figure, 33...second rectangular figure, 100, 100A, 100B...projector, 101A...remote control receiver, 105...remote control, 110A...first wireless I / F, 120A...first wired I / F, 121A...input terminal, 123A...receiving circuit, 125A...transmitting circuit, 127A...output terminal, 130A...image processing unit, 135A...frame memory, 140A...image projection unit , 141A...light source, 142A...light modulation device, 143A, 143B...liquid crystal panel, 144A, 144B...panel area, 145A...optical unit, 146A...panel drive unit, 150A...first control unit, 160A...first memory unit, 161...control program, 170A...first processor, 200...camera, 300...information processing device, 310...second wireless I / F, 320...second wired I / F, 330...third wired I / F, 340...display unit, 345...display panel, 350...operation unit, 360...second control unit, 370...second memory unit, 371...control program, 373...content file, 380...second processor.

Claims

1. acquiring a first captured image obtained by capturing an image of a projection surface onto which a first image is projected by a first projector; acquiring a second captured image obtained by capturing an image of the projection surface onto which the second image is projected by the second projector; When a tiling image is displayed in a projection area of ​​the projection surface by a first projection image projected onto the projection surface by the first projector and a second projection image projected onto the projection surface by the second projector, information indicating a resolution of the projection area is acquired based on the first captured image and the second captured image; acquiring a first correction parameter for correcting an image projected by the first projector based on the first captured image and the second captured image; acquiring second correction parameters for correcting the image projected by the second projector based on the first captured image and the second captured image; projecting, by the first projector, the first projection image generated based on an input image, the information indicating the resolution, and the first correction parameter onto the projection surface; the second projector projects the second projection image onto the projection surface, the second projection image being generated based on the input image, the information indicating the resolution, and the second correction parameter; A projection method including:

2. Obtaining information indicating a resolution of the projection area based on the first captured image and the second captured image includes: acquiring positions of four corners of the first image from the first captured image; acquiring positions of four corners of the second image from the second captured image; determining the projection area based on positions of four corners of the first image and positions of four corners of the second image; Obtaining a resolution of the projection area; The projection method of claim 1 , comprising:

3. Obtaining the resolution of the projection area includes: Obtaining a resolution of the projection area in a first direction; acquiring a resolution in a second direction of the projection area that is perpendicular to the first direction; 3. The projection method of claim 2, comprising:

4. Obtaining the resolution of the projection area includes: obtaining an even number of resolutions as the resolution in the first direction; 4. The projection method of claim 3, comprising:

5. Obtaining the resolution in the first direction includes: obtaining an aspect ratio of the projection area based on a resolution of the projection area; acquiring a preset resolution as the resolution in the second direction; obtaining a resolution in the first direction based on the aspect ratio and the preset resolution; 4. The projection method of claim 3, comprising:

6. Obtaining the resolution of the projection area includes: acquiring information on a first group of aspect ratios that can be set to the first projector; acquiring information on a second group of aspect ratios that can be set to the second projector; acquiring aspect ratios commonly included in the first aspect ratio group and the second aspect ratio group as a common aspect ratio group; acquiring, as a selected aspect ratio, an aspect ratio that has the smallest difference from the aspect ratio calculated based on the resolution of the projection area, from among the aspect ratios included in the common aspect ratio group; obtaining a resolution in the first direction and a resolution in the second direction based on the selected aspect ratio; 6. The projection method according to claim 3, further comprising:

7. Obtaining the resolution in the first direction and the resolution in the second direction based on the selected aspect ratio includes: Obtaining the number of pixels of the projection area based on the resolution of the projection area; obtaining a plurality of resolutions that have the selected aspect ratio and that are settable for the first projector and the second projector; acquiring the number of pixels for each of the plurality of resolutions; selecting a resolution from the number of pixels of the plurality of resolutions that has the smallest difference from the number of pixels of the projection area; acquiring the resolution in the first direction and the resolution in the second direction based on a resolution selected as a resolution having the smallest difference from the number of pixels of the projection area; 7. The projection method of claim 6, comprising:

8. The first projector storing information indicating the resolution and the first correction parameter; When the first projector is connected by wire to a control device that supplies the input image to the first projector, the first projector transmits Extended Display Identification Data (EDID) including information indicating a resolution of the projection area to the control device; The projection method according to claim 1 , further comprising the steps of:

9. The control device acquiring information indicating a resolution of the projection area, the first correction parameter, and the second correction parameter; transmitting information indicating a resolution of the projection area and the first correction parameter to the first projector; transmitting information indicating a resolution of the projection area and the second correction parameter to the second projector; 9. The projection method of claim 8, comprising:

10. the first image is an image including a predetermined figure at positions corresponding to at least four corners of the first image, The projection method according to claim 1 , wherein the second image includes a predetermined graphic at positions corresponding to at least four corners of the second image.

11. an imaging device that acquires a first captured image obtained by capturing an image of a projection surface onto which a first image is projected by a first projector, and a second captured image obtained by capturing an image of the projection surface onto which a second image is projected by a second projector; When a tiling image is displayed in a projection area of ​​the projection surface by a first projection image projected onto the projection surface by the first projector and a second projection image projected onto the projection surface by the second projector, information indicating a resolution of the projection area is acquired based on the first captured image and the second captured image; acquiring a first correction parameter for correcting an image projected by the first projector based on the first captured image and the second captured image; a control device that executes acquiring second correction parameters for correcting the image projected by the second projector based on the first captured image and the second captured image; the first projector that projects a first projection image onto the projection surface, the first projection image being generated based on an input image, the information indicating the resolution, and the first correction parameter; the second projector that projects a second projection image that is generated based on the input image, the information indicating the resolution, and the second correction parameter; A projection system comprising:

12. an imaging device that acquires a first captured image obtained by capturing an image of a projection surface onto which a first image is projected by a first projector, and a second captured image obtained by capturing an image of the projection surface onto which a second image is projected by a second projector; When a tiling image is displayed in a projection area of ​​the projection surface by a first projection image projected onto the projection surface by the first projector and a second projection image projected onto the projection surface by the second projector, information indicating a resolution of the projection area is acquired based on the first captured image and the second captured image; acquiring a first correction parameter for correcting an image projected by the first projector based on the first captured image and the second captured image; acquiring second correction parameters for correcting the image projected by the second projector based on the first captured image and the second captured image; transmitting information indicating a resolution of the projection area and the first correction parameter to the first projector; transmitting information indicating a resolution of the projection area and the second correction parameter to the second projector; a control device that executes the When connected to the control device, transmitting an EDID to the control device, the EDID including information indicating the resolution; the first projector that projects a first projection image that is generated based on an input image, information indicating the resolution, and the first correction parameter; a second projector configured to project a second projection image onto the projection surface, the second projection image being generated based on the input image, the information indicating the resolution, and the second correction parameter;

Images