Image projection method, program, and information processing device

Abstract

To reduce the time and effort required for adjustment by a user when moving the position of a first image on a projection surface onto which the first image and the second image are projected. [Solution] The image projection method includes: acquiring first shape information in advance that indicates the shape of a first image at each of multiple positions on a projection surface when a first projector projects a first image at each of the multiple positions; acquiring first information for moving the position of the first image on the projection surface when a second projector projects a second image at a position on the projection surface that overlaps with at least a portion of the first image; outputting second information for moving the position of the second image on the projection surface by an amount of movement corresponding to the first information; and generating first correction information, based on the first shape information and the first information, for applying geometric correction to the first image according to the position of the first image after it has been moved.

Description

[Technical Field]

[0001] The present disclosure relates to an image projection method, a program, and an information processing device. [Background technology]

[0002] Patent Document 1 discloses a multi-projection system consisting of a master projector and one or more slave projectors. In the multi-projection system described in Patent Document 1, the master projector transmits the amount of optical shift to the slave projector when an optical shift is performed, and the slave projector performs edge blend correction based on the received amount of optical shift. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-95633 Summary of the Invention [Problem to be solved by the invention]

[0004] In the multi-projection system described in Patent Document 1, when the position of the image on the projection surface changes due to optical shift, the shape of the image may change from the shape before the movement. In this case, it has traditionally been necessary to manually readjust the shape of the image, and it is desirable to reduce the effort required by the user. [Means for solving the problem]

[0005] An image projection method according to one embodiment of the present disclosure includes: acquiring first shape information in advance that indicates the shape of a first image at each of a plurality of positions on a projection surface when a first projector projects the first image at each of the positions; acquiring first information for moving the position of the first image on the projection surface when a second projector projects a second image at a position on the projection surface that overlaps with at least a portion of the first image; outputting second information for moving the position of the second image on the projection surface by an amount of movement corresponding to the first information; and generating first correction information, based on the first shape information and the first information, for performing geometric correction on the first image according to the position of the first image after movement.

[0006] A program according to one embodiment of the present disclosure causes at least one processor to perform the following operations: acquire first shape information in advance, the first shape information indicating the shape of a first image at each of a plurality of positions on a projection surface when the first image is projected from a first projector at each of the positions; acquire first information for moving the position of the first image on the projection surface when a second projector projects a second image at a position on the projection surface that overlaps with at least a portion of the first image; output second information for moving the position of the second image on the projection surface by an amount of movement according to the first information; and generate first correction information, based on the first shape information and the first information, for applying geometric correction to the first image according to the position of the first image after movement.

[0007] An information processing device according to one embodiment of the present disclosure includes at least one processor that performs the following operations: acquiring first shape information in advance, the first shape information indicating the shape of a first image at each of a plurality of positions on a projection surface when a first projector projects the first image at each of the positions; acquiring first information for moving the position of the first image on the projection surface when a second projector projects a second image at a position on the projection surface that overlaps with at least a portion of the first image; outputting second information for moving the position of the second image on the projection surface by an amount of movement corresponding to the first information; and generating first correction information, based on the first shape information and the first information, for applying geometric correction to the first image according to the position of the first image after the movement. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an outline of a system used in an image projection method according to an embodiment. [Figure 2] FIG. 2 is a block diagram of a first projector. [Figure 3] FIG. [Figure 4] 10A and 10B are explanatory diagrams illustrating the relationship between the entire image and the projectable area of ​​each projector. [Figure 5] FIG. 10 is an explanatory diagram of an entire image after a conventional lens shift. [Figure 6] 10A and 10B are explanatory diagrams of an entire image after lens shift in the image projection method according to the embodiment. [Figure 7] 1 is a flowchart of an image projection method according to an embodiment. [Figure 8] FIG. 10 is an explanatory diagram of acquisition of first shape information. [Figure 9] FIG. 10 is an explanatory diagram of acquisition of third correction information. DETAILED DESCRIPTION OF THE INVENTION

[0009] Preferred embodiments of the present disclosure will be described below with reference to the accompanying drawings. Note that the dimensions and scale of each part in the drawings may differ from the actual dimensions and are shown schematically to facilitate understanding. Furthermore, the scope of the present disclosure is not limited to these embodiments unless otherwise specified in the following description to the effect that the present disclosure is limited. 1. Embodiment 1-1. Overview of the system used for the image projection method 1 is a diagram showing an outline of a system 100 used in an image projection method according to an embodiment. The system 100 is a multi-projection system that projects an entire image GG onto a projection surface SC.

[0010] 1, the system 100 includes a first projector 10-1, a second projector 10-2, and a terminal device 30. The first projector 10-1 is an example of a "projector." Below, the first projector 10-1 and the second projector 10-2 may be referred to as projector 10 without distinction.

[0011] The system 100 uses multiple projectors 10 to project an entire image GG onto a projection surface SC. In the example shown in Fig. 1, the system 100 uses two projectors 10 to project the entire image GG onto the projection surface SC. The projection surface SC is the surface of an object such as a screen. In the example shown in Fig. 1, the projection surface SC is a flat surface.

[0012] The projection surface SC is not limited to a flat surface, and may be, for example, a curved surface. In addition, in the present embodiment, an example is shown in which the number of projectors 10 included in the system 100 is two, but the present invention is not limited to this example, and the number may be three or more. In other words, the entire image GG may include images projected from three or more projectors 10.

[0013] The first projector 10-1 is a display device that projects a first image G1 indicated by video data IMG1 output from the terminal device 30 onto the projection surface SC. On the other hand, the second projector 10-2 is a display device that projects a second image G2 indicated by video data IMG2 output from the terminal device 30 onto the projection surface SC.

[0014] In this manner, the first projector 10-1 projects the first image G1 onto the projection surface SC, and the second projector 10-2 projects the second image G2 onto the projection surface SC, thereby projecting an entire image GG including the first image G1 and the second image G2 onto the projection surface SC. The first image G1 and the second image G2 are arranged in this order in the arrangement direction DR. Here, the first image G1 and the second image G2 are projected onto the projection surface SC in a state where they are spliced ​​together so that the entire image GG displays a single image. In the example shown in FIG. 1, the first image G1 is projected onto the left region of the projection surface SC in FIG. 1, while the second image G2 is projected onto the right region of the projection surface SC in FIG. 1. Then, the right end of the first image G1 in FIG. 1 and the left end of the second image G2 in FIG. 1 are spliced ​​together. That is, the right edge of the first image G1 in FIG. 1 overlaps with the left edge of the second image G2 in FIG.

[0015] The first image G1 and the second image G2 partially overlap each other in an overlap region R. The overlap region R is an area where a blending process, which will be described later, is performed to make the seam between the first image G1 and the second image G2 less noticeable. In this way, in the system 100, the overlap region R is set so that the first image G1 projected from the first projector 10-1 and the second image G2 projected from the second projector 10-2 partially overlap on the projection surface SC.

[0016] The first projector 10-1 has a lens shift function that changes the position of the first image G1 on the projection surface SC while keeping the position and attitude of the first projector 10-1 relative to the projection surface SC fixed. Similarly, the second projector 10-2 has a lens shift function that changes the position of the second image G2 on the projection surface SC while keeping the position and attitude of the second projector 10-2 relative to the projection surface SC fixed. The lens shift function is also called an optical shift function.

[0017] Furthermore, the first projector 10-1 has a correction function for correcting the shape of the first image G1 on the projection surface SC. Similarly, the second projector 10-2 has a correction function for correcting the shape of the second image G2 on the projection surface SC.

[0018] In this embodiment, the first projector 10-1 is the main device and controls the operation of the second projector 10-2, which is the sub device. Even if the position of the first image G1 on the projection surface SC changes due to the lens shift function of the first projector 10-1, the first projector 10-1 maintains the shape of the first image G1 on the projection surface SC due to the correction function of the first projector 10-1. Furthermore, by controlling the operation of the second projector 10-2, the first projector 10-1 changes the position of the second image G2 on the projection surface SC due to the lens shift function of the second projector 10-2, and maintains the shape of the second image G2 on the projection surface SC due to the correction function of the second projector 10-2. This makes it possible to change the position of the entire image GG on the projection surface SC while maintaining the shape of the entire image GG.

[0019] The second projector 10-2 is configured similarly to the first projector 10-1 except that its operation is controlled by the first projector 10-1. Note that the second projector 10-2 may have a different configuration from the first projector 10-1 as long as its operation can be controlled by the first projector 10-1. When the system 100 has three or more projectors 10, one projector 10 of the three or more projectors 10 is a main device, and the other two or more projectors 10 are sub-devices.

[0020] The terminal device 30 is a device that has the function of dividing video data showing one image into multiple video data to be projected by multiple projectors 10, and the function of supplying each of the video data resulting from the division process to the corresponding projector 10.

[0021] Terminal device 30 of the present embodiment divides video data showing one image into video data IMG1 and video data IMG2, and then supplies video data IMG1 to first projector 10-1 and video data IMG2 to second projector 10-2. Terminal device 30 may supply video data IMG1 and video data IMG2 to first projector 10-1. In this case, first projector 10-1 supplies video data IMG2 to second projector 10-2. Alternatively, terminal device 30 may supply video data to first projector 10-1, and first projector 10-1 may perform a division process on the video data.

[0022] 1, the terminal device 30 is a notebook computer. However, the terminal device 30 is not limited to a notebook computer and may be, for example, a desktop computer, a smartphone, a tablet terminal, a video playback device, a DVD (Digital Versatile Disk) player, a Blu-ray Disc player, a hard disk recorder, a television tuner device, a CATV (Cable television) set-top box, a video game console, etc.

[0023] 1-2.Projector FIG. 2 is a block diagram of the first projector 10-1. In addition to the first projector 10-1, FIG. 2 also shows the connection state of the second projector 10-2 and the terminal device 30 to the first projector 10-1. Note that while FIG. 2 representatively shows the configuration of the first projector 10-1, the configuration of the second projector 10-2 is the same as that of the first projector 10-1 except that the second projector 10-2 does not execute the program PR1 described below. Therefore, in the following description of the components of the second projector 10-2, the first projector 10-1 can be read as the second projector 10-2 and the video data IMG1 can be read as the video data IMG2. In the following, the components of the projector 10 may be distinguished from the components of the first projector 10-1 by adding a suffix "-1" to the reference numeral of the component of the first projector 10-1 or by adding a suffix "-2" to the reference numeral of the component of the second projector 10-2.

[0024] 2, the first projector 10-1 has a storage device 11, a processing device 12, a communication device 13, an image processing circuit 14, an optical device 15, an operation device 16, an imaging device 17, and a sensor 18. These are connected to each other so that they can communicate with each other.

[0025] The storage device 11 is a storage device that stores programs executed by the processing device 12 and data processed by the processing device 12. The storage device 11 includes, for example, a hard disk drive or a semiconductor memory. Note that part or all of the storage device 11 may be provided in an external storage device or server outside the first projector 10-1.

[0026] The storage device 11 stores a program PR1, first shape information DS1, second shape information DS2, first information D1, second information D2, first correction information DC1, second correction information DC2, and third correction information DC3.

[0027] The program PR1 is a program for executing an image projection method, which will be described in detail later.

[0028] The first shape information DS1 is information indicating the shape of the first image G1 at each position on the projection surface SC when the first projector 10-1 projects the first image G1 onto each of the multiple positions on the projection surface SC. Specifically, for example, if the intended shape of the first image G1 is a rectangle, the first shape information DS1 is information regarding coordinate values ​​indicating multiple positions, including the positions of four corners and four sides, of the first image G1 on the projection surface SC, for each position of the first image G1 on the projection surface SC. The coordinate values ​​are, for example, coordinate values ​​of a display coordinate system set in the optical device 15 described below or a coordinate system associated therewith. However, as described below, the shape of the first image G1 on the projection surface SC may differ from position to position due to the influence of lens shift, resulting in a shape that deviates from the intended shape.

[0029] In this way, the first shape information DS1 indicates the correspondence relationship between the positions when the first image G1 is projected from the first projector 10-1 onto each of a plurality of positions on the projection surface SC and the shape of the first image G1 on the projection surface SC. Note that the first shape information DS1 is not limited to the information indicating the coordinate values ​​described above as long as it is information that directly or indirectly indicates the degree of deformation of the first image G1 at each position on the projection surface SC, and may be, for example, imaging data obtained by imaging the first image G1 on the projection surface SC with the imaging device 17, information that indicates the value of a variable or the like that indicates the degree of deformation of the shape of the first image G1, or information that indicates a correction value for correcting the first image G1 to a desired shape.

[0030] The second shape information DS2 is information indicating the shape of the second image G2 at each position on the projection surface SC when the second projector 10-2 projects the second image G2 onto each of the multiple positions on the projection surface SC. Specifically, for example, if the intended shape of the second image G2 is a rectangle, the second shape information DS2 is information regarding coordinate values ​​indicating multiple positions, including the positions of the four corners and the positions of the four sides of the second image G2, for each position of the second image G2 on the projection surface SC. The coordinate values ​​are, for example, coordinate values ​​of a display coordinate system set in the optical device 15 described below or a coordinate system associated therewith. However, as described below, the shape of the second image G2 on the projection surface SC may differ from position to position due to the influence of lens shift, resulting in a shape that deviates from the intended shape.

[0031] In this way, the second shape information DS2 indicates the correspondence relationship between the positions when the second image G2 is projected from the second projector 10-2 onto each of a plurality of positions on the projection surface SC and the shape of the second image G2 on the projection surface SC. Note that the second shape information DS2 is not limited to the information indicating the coordinate values ​​described above as long as it is information that directly or indirectly indicates the degree of deformation of the second image G2 at each position on the projection surface SC, and may be, for example, imaging data obtained by imaging the second image G2 on the projection surface SC with the imaging device 17, information that indicates the value of a variable or the like that indicates the degree of deformation of the shape of the second image G2, or information that indicates a correction value for correcting the second image G2 to a desired shape.

[0032] The first information D1 is information for moving the position of the first image G1 on the projection surface SC when the second projector 10-2 projects the second image G2 to a position on the projection surface SC that overlaps at least a portion of the first image G1. Specifically, the first information D1 is either information for optically moving the position of the first image G1 or information for electronically moving the position of the first image G1, and indicates, for example, the amount and direction of movement of the first image G1 on the projection surface SC. Hereinafter, optically moving the position of the projected image may be referred to as "lens shift," and electronically moving the position of the projected image may be referred to as "electronic shift." Note that, while the following mainly describes aspects that use lens shift, the same applies to electronic shift, and the term "lens shift" may be appropriately replaced with "electronic shift."

[0033] The first information D1 includes first direction information D1a, first attitude information D1b, and first quantity information D1c.

[0034] The first direction information D1a is information indicating up, down, left, and right with respect to the main body of the first projector 10-1, and indicates the direction in which the lens of the projection optical system 15c of the first projector 10-1 is moved in the case of optical shift, and indicates the direction in which the image is moved on the optical modulator 15b of the first projector 10-1 in the case of electronic shift. Here, the direction with respect to the main body of the first projector 10-1 as the reference is determined by the specifications of the first projector 10-1.

[0035] The first attitude information D1b is information that indicates the installation attitude of the first projector 10-1. The first attitude information D1b is information that indicates, for example, the detection result of the sensor 18 of the first projector 10-1.

[0036] The first amount information D1c is information that indicates the amount of movement of the position of the first image G1 on the projection surface SC. More specifically, in the case of optical shift, the first amount information D1c is information that indicates the number of steps of a motor provided in a mechanism that moves the lens of the projection optical system 15c of the first projector 10-1 for lens shift, and in the case of electronic shift, the first amount information D1c is information that indicates the number of pixels of movement of the image on the optical modulator 15b of the first projector 10-1.

[0037] The first attitude information D1b may be information indicating the relationship between the up-down orientation of the main body of the first projector 10-1 and the up-down orientation based on the direction of gravity, for example, information indicating whether the projector is so-called ceiling-suspended. Here, the relationship indicated by the first attitude information D1b may include information indicating the tilt angle with respect to the horizontal plane, or may include information indicating the orientation of the first projector 10-1 with respect to the projection surface SC in addition to the orientation of the first projector 10-1 with respect to the up-down orientation based on gravity information. For example, the first attitude information D1b may include information indicating whether the projector is so-called front projection, in which projection is performed from the viewer's side, or rear projection, in which projection is performed from the rear of the projection surface SC. Furthermore, when front projection and rear projection are taken into consideration, the first attitude information D1b may include information indicating four installation attitudes, including front-ceiling-suspended projection and rear-ceiling-suspended projection, in addition to front projection and rear projection. The method of acquiring the attitude indicated by the first attitude information D1c may be a method of acquiring it based on the detection result of the sensor 18, or may be a method of reading out the setting information of the first projector 10-1 and acquiring it based on the setting information, for example. In this case, the sensor 18 may be omitted.

[0038] The second information D2 is information for moving the position of the second image G2 on the projection surface SC by an amount of movement corresponding to the first information D1. Specifically, the second information D2 is information for controlling the operation of the second projector 10-2, and is either information for optically moving the position of the second image G2 or information for electronically moving the position of the second image G2, and indicates, for example, the amount of movement and the direction of movement of the second image G2 on the projection surface SC. Typically, the amount of movement and the direction of movement indicated by the second information D2 are equal to the amount of movement and the direction of movement indicated by the first information D1. In this embodiment, the second information D2 includes information indicating the amount of movement and the direction of movement of the second image G2 on the projection surface SC, as well as information indicating the speed of movement of the second image G2 on the projection surface SC, as necessary.

[0039] The second information D2 includes second direction information D2a, first speed information D2b, and second amount information D2c.

[0040] The second direction information D2a is information indicating up, down, left, and right with respect to the main body of the second projector 10-2, and indicates the direction in which the lens of the projection optical system 15c of the second projector 10-2 is moved in the case of optical shift, and indicates the direction in which the image is moved on the optical modulator 15b of the second projector 10-2 in the case of electronic shift. Here, the direction with respect to the main body of the second projector 10-2 as the reference is determined by the specifications of the second projector 10-2.

[0041] The first speed information D2b is information for controlling the drive speed of the motor, and indicates a speed equal to the speed at which the first projector 10-1 moves the position of the first image G1. Note that the first speed information D2b only needs to be included in the second information D2 when the movement speed of the first image G1 is slower than the maximum movement speed of the second image G2, and does not have to be included in the second information D2 when the movement speed of the first image G1 is faster than the maximum movement speed of the second image G2.

[0042] The second amount information D2c is information that indicates the amount of movement of the position of the second image G2 on the projection surface SC. More specifically, in the case of optical shift, the second amount information D2c is information that indicates the number of steps of a motor provided in a mechanism that moves the lens of the projection optical system 15c of the second projector 10-2 for lens shift, and in the case of electronic shift, the second amount information D2c is information that indicates the number of pixels of movement of the image on the optical modulator 15b of the second projector 10-2.

[0043] The first correction information DC1 is information for performing geometric correction on the first image G1 according to the position of the first image G1 after it has moved. Specifically, the first correction information DC1 is, for example, information indicating a correction value for performing geometric correction on the first image G1 according to the position of the first image G1 after it has moved.

[0044] The second correction information DC2 is information for performing geometric correction on the second image G2 according to the position of the second image G2 after it has moved. Specifically, the second correction information DC2 is, for example, information indicating a correction value for performing geometric correction on the second image G2 according to the position of the second image G2 after it has moved.

[0045] The third correction information DC3 is information related to the correction of the overlapping area R of the first image G1 and the second image G2 on the projection surface SC when the position of the entire image GG is changed. Specifically, the third correction information DC3 is information indicating values ​​of the width, shape, blend curve, etc. of the blending area R1 (described later) after correction when the position of the entire image GG is changed, for example.

[0046] The processing device 12 has a function of controlling each unit of the first projector 10-1 and a function of processing various data. The processing device 12 includes at least one processor, such as a CPU (Central Processing Unit). The processing device 12 may be configured with a single processor or multiple processors. Some or all of the functions of the processing device 12 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 12 may be integrated with the image processing circuit 14.

[0047] The communication device 13 is a communication device capable of communicating with various devices, and acquires video data IMG1 from the terminal device 30 and communicates with the second projector 10-2. For example, the communication device 13 is a wired communication device such as a wired LAN (Local Area Network), USB (Universal Serial Bus), or HDMI (High Definition Multimedia Interface), or a wireless communication device such as LPWA (Low Power Wide Area), wireless LAN including Wi-Fi, or Bluetooth. "HDMI," "Wi-Fi," and "Bluetooth" are all registered trademarks.

[0048] The image processing circuit 14 performs necessary processing on the video data IMG1 from the communication device 13 and inputs the data to the optical device 15. The image processing circuit 14, for example, has a frame memory (not shown), and loads the video data IMG1 into the frame memory, appropriately performs various processes such as resolution conversion, resizing, and distortion correction, and inputs the data to the optical device 15. The image processing circuit 14 may also perform processes such as OSD (On Screen Display) processing, which generates image information for menu display or operation guides and combines it with the video data IMG1, as needed. The image processing circuit 14 may also correct the shape of the first image G1 based on first correction information DC1 stored in the storage device 11, or may correct a portion of the first image G1 used in the superimposition region R based on third correction information DC3 stored in the storage device 11.

[0049] The optical device 15 is a device that projects image light onto the projection surface SC, and includes a light source 15a, a light modulator 15b, and a projection optical system 15c.

[0050] The light source 15a includes a light source such as a halogen lamp, a xenon lamp, an ultra-high pressure mercury lamp, an LED (Light Emitting Diode), or a laser light source, and emits red, green, and blue light, respectively. The light modulator 15b renders an image based on video data IMG1 supplied from the terminal device 30. The light modulator 15b includes three light modulation elements corresponding to red, green, and blue. Each light modulation element includes, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, or a DMD (Digital Mirror Device), and generates image light of each color by modulating light of the corresponding color. The image light of each color generated by the light modulator 15b is combined by a color synthesis optical system to become full-color image light. The projection optical system 15c is an optical system including a projection lens that focuses and projects the full-color image light from the light modulator 15b onto the projection surface SC. The image rendered on the light modulator 15b, i.e., the rendered image, is projected onto the projection surface SC via the projection lens.

[0051] The optical device 15 has a mechanism for changing the relative positional relationship between the light modulator 15b and the projection optical system 15c, and changing this positional relationship realizes an optical lens shift function. That is, by changing the relative positional relationship between the light modulator 15b and the projection optical system 15c, the optical device 15 changes the position of the first image G1 on the projection surface SC while keeping the position and attitude of the first projector 10-1 relative to the projection surface SC fixed. Typically, the lens shift function is realized by a mechanism including a stepping motor that moves the position of a projection lens that emits image light onto the projection surface SC.

[0052] In addition, in the optical device 15, the drawing position in the light modulator 15b can be changed, and an electronic shift function may be realized by changing the drawing position. In other words, the optical device 15 may change the position of the first image G1 on the projection surface SC while keeping the position and attitude of the first projector 10-1 relative to the projection surface SC fixed, by changing the drawing position in the light modulator 15b.

[0053] The operation device 16 is a device that accepts operations from a user. For example, the operation device 16 includes an operation panel and a remote control receiver, not shown. The operation panel is provided on the exterior housing of the first projector 10-1, and outputs a signal based on an operation from the user. The remote control receiver receives an infrared signal from a remote control, not shown, decodes the infrared signal, and outputs a signal based on the operation of the remote control. Note that the operation device 16 is provided as needed, and a part of it may be omitted.

[0054] The imaging device 17 is a digital camera having an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The imaging element has a plurality of pixels.

[0055] Sensor 18 is a sensor for estimating the attitude of projector 10 with respect to projection surface SC. Sensor 18 includes, for example, a distance sensor and an acceleration sensor. The distance sensor is a time-of-flight (ToF) distance sensor that measures the shape of projection surface SC. The acceleration sensor is a sensor that detects acceleration on three mutually perpendicular axes, and detects the acceleration applied to projector 10. Based on the detection results of sensor 18, the installation attitude of first projector 10-1 can be estimated.

[0056] Note that sensor 18 only needs to be able to obtain the detection results necessary to estimate the attitude of projector 10 with respect to projection surface SC, and may, for example, be configured such that one of the distance sensor and acceleration sensor is omitted, or such that one or both of the distance sensor and acceleration sensor are replaced with an inertial sensor such as an angular velocity sensor and a camera. Also, the attitude of projector 10 with respect to projection surface SC may be estimated based on input information such as menu settings of first projector 10-1.

[0057] In the first projector 10-1 described above, the processing device 12 functions as a projection control unit 12a, an imaging control unit 12b, and a correction unit 12c by executing the program PR1 stored in the storage device 11. Therefore, the processing device 12 includes the projection control unit 12a, the imaging control unit 12b, and the correction unit 12c.

[0058] The projection control unit 12a controls the operation of the image processing circuit 14 and the optical device 15 of each of the first projector 10-1 and the second projector 10-2. More specifically, the projection control unit 12a projects the first image G1 onto the projection surface SC and projects the second image G2 onto the projection surface SC, thereby projecting the entire image GG onto the projection surface SC.

[0059] After the installation of the first projector 10-1 and the second projector 10-2 is completed, in order to obtain the first shape information DS1 and the second shape information DS2 in advance, the projection control unit 12a uses the lens shift function of the first projector 10-1 to project a first image G1 from the first projector 10-1 onto each of multiple positions on the projection surface SC, and uses the lens shift function of the second projector 10-2 to project a second image G2 from the second projector 10-2 onto each of multiple positions on the projection surface SC.

[0060] After acquiring the first shape information DS1 and the second shape information DS2, the projection control unit 12a corrects the shape of the first image G1 on the projection surface SC using the correction function of the first projector 10-1 based on the first correction information DC1, and corrects the shape of the second image G2 on the projection surface SC using the correction function of the second projector 10-2 based on the second correction information DC2.

[0061] The imaging control unit 12b controls the operation of the imaging device 17 of one or both of the first projector 10-1 and the second projector 10-2. More specifically, the imaging control unit 12b causes the imaging device 17 to capture the first image G1 projected at each of the multiple positions on the projection surface SC, and causes the imaging device 17 to capture the second image G2 projected at each of the multiple positions on the projection surface SC.

[0062] The correction unit 12c acquires in advance the first shape information DS1 based on the results of capturing an image of a first image G1 projected onto each of a plurality of positions on the projection surface SC using the imaging device 17, and acquires in advance the second shape information DS2 based on the results of capturing an image of a second image G2 projected onto each of a plurality of positions on the projection surface SC using the imaging device 17.

[0063] Furthermore, the corrector 12c acquires in advance the third correction information DC3 based on the results of capturing, by the imaging device 17, the first image G1 projected at each of the multiple positions on the projection surface SC.

[0064] Furthermore, the correction unit 12c acquires first information D1 via the communication device 13 from a device for remotely operating the first projector 10-1 or a device such as the terminal device 30, and outputs second information D2 based on the acquired first information D1.

[0065] Furthermore, the correction unit 12c generates first correction information DC1 based on the third correction information DC3, the first shape information DS1, and the first information D1, and generates second correction information DC2 based on the second shape information DS2 and the second information D2. Note that when the positions and attitudes of the first projector 10-1 and the second projector 10-2 with respect to the projection surface SC are changed, the first correction information DC1 and the second correction information DC2 are regenerated under new conditions as necessary.

[0066] 1-3. Overall image Fig. 3 is an explanatory diagram of the entire image GG, which shows an example of the relationship between the brightness BR1 of the first image G1 and the brightness BR2 of the second image G2 when the brightness of the entire image GG is uniform.

[0067] When the entire image GG is projected onto the projection surface SC, the first image G1 has a non-overlapping area RN1 and a blending area R1. The non-overlapping area RN1 is an area that does not overlap with the second image G2. The blending area R1 is an area that overlaps with the second image G2. A blending process is performed on the blending area R1. The blending process changes the brightness in the arrangement direction DR in which the first image G1 and the second image G2 are arranged so that the brightness of the overlapping area R matches the brightness of the non-overlapping area RN1 when the first image G1 and the second image G2 are projected so that they overlap each other in the overlapping area R.

[0068] On the other hand, when the entire image GG is projected onto the projection surface SC, the second image G2 has a non-overlapping area RN2 and a blending area R2. The non-overlapping area RN2 is an area that does not overlap with the first image G1. The blending area R2 is an area for overlapping with the first image G1. A blending process is performed on the blending area R2.

[0069] In the blending region R1 of the first image G1, the brightness BR1 of the first image G1 changes from the brightness of the non-overlapping region RN1 to zero over the range α of the overlapping region R as it moves in the arrangement direction DR. Note that in the blending region R1, the distribution of the brightness BR1 in the arrangement direction DR, i.e., the blending curve, is not limited to the example shown in FIG. 3, as long as the brightness of the overlapping region R matches the brightness of the non-overlapping region RN1.

[0070] On the other hand, in the blending region R2 of the second image G2, the brightness BR2 of the second image G2 changes from the brightness of the non-overlapping region RN2 to zero over the range α of the overlapping region R as it moves in the direction opposite to the arrangement direction DR. Note that in the blending region R2, the distribution of the brightness BR2 in the arrangement direction DR, i.e., the blending curve, is not limited to the example shown in FIG. 3, as long as the brightness of the overlapping region R matches the brightness of the non-overlapping region RN2.

[0071] 4 is an explanatory diagram of the relationship between the entire image GG and the projectable areas RP1 and RP2 of each projector 10. The projectable area RP1 is the largest area that the first projector 10-1 can project and includes the first image G1. On the other hand, the projectable area RP2 is the largest area that the second projector 10-2 can project and includes the second image G2.

[0072] Fig. 4 shows a state in which the entire image GG is displayed in a normal shape on the projection surface SC. In the example shown in Fig. 4, the shape of the entire image GG on the projection surface SC is rectangular. Here, the shape of the first image G1 and the shape of the second image G2 on the projection surface SC are both rectangular. Furthermore, the position of the projectable area RP1 is position P1-a, and the position of the projectable area RP2 is position P2-a.

[0073] Fig. 5 is an explanatory diagram of an entire image GG after conventional lens shifting. Fig. 5 shows an entire image GG when the position of projectable area RP1 is changed from position P1-a to position P1-b by the lens shift function of first projector 10-1 and the position of projectable area RP2 is changed from position P2-a to position P2-b by the lens shift function of second projector 10-2, without correcting the shapes of first image G1 and second image G2.

[0074] 5, the position of the first image G1 on the projection surface SC changes as the position of the projectable area RP1 changes. Similarly, the position of the second image G2 on the projection surface SC changes as the position of the projectable area RP2 changes.

[0075] Here, even if the direction and amount of movement from position P1-a to position P1-b are the same as the direction and amount of movement from position P2-a to position P2-b, simply changing the positions of the projectable areas RP1 and RP2 will result in the first image G1 and the second image G2 on the projection surface SC having shapes that differ from their normal shapes. As a result, the overall image GG on the projection surface SC will also have a shape that differs from its normal shape. This type of deformation of the overall image GG can occur even if the direction and amount of movement from position P1-a to position P1-b are the same as the direction and amount of movement from position P2-a to position P2-b.

[0076] Factors that cause the shape of the overall image GG on the projection surface SC to be distorted when the lens shift function is executed include, for example, differences in the type of projection optical system 15c between the first projector 10-1 and the second projector 10-2, differences in the projection angle or projection distance, etc.

[0077] 6 is an explanatory diagram of the entire image GG after lens shift in the image projection method according to the embodiment. In system 100, even when the position of projectable area RP1 is changed from position P1-a to position P1-b and the position of projectable area RP2 is changed from position P2-a to position P2-b, the shape of the entire image GG on projection surface SC is maintained in a normal shape, as shown in FIG.

[0078] Here, first projector 10-1 corrects the shape of first image G1 to a normal shape within projectable area RP1 using a correction function. Similarly, second projector 10-2 corrects the shape of second image G2 to a normal shape within projectable area RP2 using a correction function. Note that correcting to a normal shape means correcting geometric distortion to make the shape of the image closer to a rectangle, typically a rectangle.

[0079] By changing the position of the entire image GG on the projection surface SC in this way, an empty area RF can be created on the projection surface SC. This allows the empty area RF to be used as a display area for other content or as a handwriting area. If an object is placed in front of a part of the screen SC, changing the position of the entire image GG can also eliminate the overlap between the entire image GG and the object. Note that the object, such as the screen having the projection surface SC, may be moved as long as the shape and position of the area of ​​the projection surface SC that can be projected from the projector 10 do not change.

[0080] 1-4. Image projection method 7 is a flowchart of an image projection method according to an embodiment. The image projection method includes steps S10 to S70. These steps are performed by processing device 12 of first projector 10-1 executing program PR1.

[0081] First, in step S10, the processing device 12 of the first projector 10-1 displays a normal overall image GG. Specifically, after fixing the relationship between the positions and attitudes of the first projector 10-1 and the second projector 10-2 relative to the projection surface SC, in step S10, the processing device 12 functioning as the projection control unit 12a of the first projector 10-1 causes the first projector 10-1 to project a first image G1 of a normal shape onto the projection surface SC, and causes the second projector 10-2 to project a second image G2 of a normal shape onto the projection surface SC, as shown in FIG. 4 above. This causes the normal overall image GG to be projected onto the projection surface SC.

[0082] The method for projecting the entire image GG of a normal shape onto the projection surface SC in step S10 is not particularly limited, and various known geometric correction methods can be used. For example, based on the results of capturing the first image G1 and the second image G2 to be projected onto the projection surface SC using the imaging device 17, the shapes of each image are measured using a known image recognition technology, and based on the measurement results, the shapes of the first image G1 and the second image G2 are corrected using a known geometric correction method so that the entire image GG has a desired shape. Also, in step S10, the width of the overlap region R is determined and blending processing is performed using a known technology so that the entire image GG has a desired image quality.

[0083] After step S10, in step S20, the processing device 12 of the first projector 10-1 acquires first shape information DS1 and second shape information DS2 as shape information. Specifically, step S20 includes steps S21 and S22. In step S21, the processing device 12 functioning as the imaging control unit 12b and the correction unit 12c of the first projector 10-1 acquires the first shape information DS1 in advance. In step S22, the processing device 12 functioning as the imaging control unit 12b and the correction unit 12c of the first projector 10-1 acquires the second shape information DS2 in advance. Note that the order in which steps S21 and S22 are performed is not particularly limited and may be arbitrary. The term "in advance" in steps S20 and S30 refers to a point in time prior to the execution of the function of moving the position of the entire image GG.

[0084] After step S20, in step S30, processing device 12 functioning as correction unit 12c of first projector 10-1 acquires third correction information DC3 in advance. In step S30, third correction information DS3 is generated by appropriately using the results of imaging performed by imaging device 17 when generating first shape information DS1 and second shape information DS2 in step S20. Note that step S30 may be executed before step S20 or may be executed simultaneously with step S20.

[0085] After step S30, in step S40, processing device 12 functioning as correction unit 12c of first projector 10-1 acquires first information D1. Here, first information D1 is acquired by processing device 12 of first projector 10-1 based on information such as control information within first projector 10-1 triggered by a control signal from a device for remotely operating first projector 10-1 or a device such as terminal device 30. As a result, the operation of first projector 10-1 is controlled based on first information D1.

[0086] After step S40, in step S50, the processing device 12 functioning as the correction unit 12c of the first projector 10-1 outputs the second information D2. Here, the second information D2 is output from the first projector 10-1 to the second projector 10-2 as, for example, a control signal for controlling the operation of the second projector 10-2. As a result, the operation of the second projector 10-2 is controlled based on the second information D2.

[0087] As described above, the second information D2 includes second direction information D2a. The second direction information D2a is generated based on the first direction information D1a and the first attitude information D1b. Therefore, outputting the second information D2 in step S50 includes outputting the second direction information D2a based on the first direction information D1a and the first attitude information D1b. Here, if the attitudes of the first projector 10-1 and the second projector 10-2 are different from each other, specifying the same direction will result in a deviation in the direction in which the image is actually moved on the projection surface SC. Therefore, the second direction information D2a is generated from the attitudes of the first projector 10-1 and the second projector 10-2 so that the direction in which the image is actually moved on the projection surface SC is the same. For example, if the posture of the first projector 10-1 is a front-mounted projection posture, which is "up" relative to the main body and "down" relative to the direction of gravity, and the posture of the second projector 10-2 is a front projection posture, which is "up" relative to the main body and "up" relative to the direction of gravity, then if the image movement direction of the first projector 10-1 is to the right, the image movement direction of the second projector 10-2 will be to the left.

[0088] Furthermore, when the speed at which the first projector 10-1 moves the position of the first image G1 is defined as the first speed and the maximum speed at which the second projector 10-2 can move the position of the second image G2 is defined as the second speed, if the first speed is slower than the second speed, the second information D2 includes first speed information D2b, which is information indicating the first speed.

[0089] After step S50, in step S60, the processing device 12 functioning as the correction unit 12c of the first projector 10-1 generates first correction information DC1 and second correction information DC2 as correction information. Step S60 includes steps S61 and S62. In step S61, the processing device 12 of the first projector 10-1 generates the first correction information DC1 based on the first shape information DS1 and the first information D1. In this embodiment, in step S61, the processing device 12 of the first projector 10-1 generates the first correction information DC1 using third correction information DC3 in addition to the first shape information DS1 and the first information D1. In step S62, the processing device 12 of the first projector 10-1 generates the second correction information DC2 based on the second shape information DS2 and the second information D2. Note that the order of execution of steps S61 and S62 is not particularly limited and may be arbitrary.

[0090] After step S60, in step S70, the processing device 12 functioning as the correction unit 12c of the first projector 10-1 corrects the entire image GG based on the first correction information DC1 and the second correction information DC2. Specifically, in step S70, the processing device 12 of the first projector 10-1 controls the operation of the image processing circuit 14 and the optical device 15 of the first projector 10-1 based on the first correction information DC1, and controls the operation of the image processing circuit 14 and the optical device 15 of the second projector 10-2 based on the second correction information DC2. As a result, the shape of the first image G1 on the projection surface SC is corrected to a normal shape, and the shape of the second image G2 on the projection surface SC is corrected to a normal shape. As a result, the shape of the entire image GG is corrected to a normal shape.

[0091] Here, the correction timing of the first image G1 and the correction timing of the second image G2 may be simultaneous or different. Furthermore, the movement speed of the first image G1 and the movement speed of the second image G2 may be different from each other or may be equal to each other. However, if the correction timing of the first image G1 and the correction timing of the second image G2 are simultaneous, it is preferable that the movement speed of the first image G1 and the movement speed of the second image G2 are equal to each other. This makes it possible to display the entire image GG while reducing the sense of incongruity.

[0092] After step S70, in step S80, the processing device 12 determines whether or not to terminate. This determination is made based on, for example, whether or not there is an instruction to terminate from the user. If not to terminate (step S80: NO), the processing device 12 returns to step S40. This causes the above-mentioned steps S40 to S70 to be repeated. On the other hand, if to terminate (step S80: YES), the processing device 12 terminates the processing.

[0093] 8 is an explanatory diagram of the acquisition of the first shape information DS1 in step S21. The acquisition of the first shape information DS1 will be representatively described below. Note that the acquisition of the second shape information DS2 in step S22 is performed in the same manner as the acquisition of the first shape information DS1 in step S21, except that the target projector 10 is different.

[0094] In step S21, the processing device 12 of the first projector 10-1 moves the position of the first image G1 on the projection surface SC using a lens shift function, as shown in FIG. 8. At this time, the processing device 12 of the first projector 10-1 uses the imaging device 17 to capture the first image G1 at each position and measures the shape of the first image G1 at each position using the imaging results. Also, at this time, the movement speed of the first image G1 on the projection surface SC is measured. Information indicating the measurement results is stored in the storage device 11, and may be used to determine whether or not to include first speed information D2b in the second information D2 in step S50.

[0095] Note that the first image G1 in step S21 is not particularly limited and may be the same as or different from that used when the entire image GG is projected, but from the perspective of improving the accuracy of shape detection in the image captured by the imaging device 17, it is preferably an image such as that shown in Fig. 9, which will be described later. Also, the relationship in size between the first image G1 and the projectable area RP1 in step S21 is not particularly limited, but it is preferably the same as the relationship in size between the first image G1 and the projectable area RP1 used when the entire image GG is projected. Also, from the perspective of improving the accuracy of shape detection in the image captured by the imaging device 17, it is preferable that the second image G2 is not projected onto the projection surface SC in step S21, or that the first image G1 and the second image G2 do not overlap on the projection surface SC.

[0096] In step S21, when the position of the first image G1 is the position of the center PC of the first image G1, the movement range of the position of the first image G1 on the projection surface SC is within an area surrounded by a rectangle with four points p1, p2, p3, and p4 as corners. Point p1 is a point on the projection surface SC that is the uppermost and leftmost position that the center PC can reach using the lens shift function. Point p2 is a point on the projection surface SC that is the uppermost and rightmost position that the center PC can reach using the lens shift function. Point p3 is a point on the projection surface SC that is the lowermost and leftmost position that the center PC can reach using the lens shift function. Point p4 is a point on the projection surface SC that is the lowermost and rightmost position that the center PC can reach using the lens shift function.

[0097] In step S21, the lens shift function moves the center PC of the first image G1 sequentially through multiple positions within the aforementioned region defined by points p1, p2, p3, and p4 in an appropriate order. The multiple positions are, for example, positions corresponding to a predetermined number of steps of a motor provided in a mechanism for moving the lens for shifting. The multiple positions may be distributed within a required range of the region, and may be distributed over a portion of the region or over the entire region. The multiple positions may be equally spaced, or at least some of them may not be equally spaced.

[0098] In this way, when the position of the first image G1 on the projection surface SC is changed using the lens shift function, the shape of the first image G1 on the projection surface SC changes. The first image G1 at each position projected onto the projection surface SC is captured by the imaging device 17. Then, the contour of the first image G1 in the captured image is detected using a known image recognition technique. Information indicating the coordinate values ​​of the four corners and midpoints of the four sides of the detected contour is stored in the storage device 11 as first shape information DS1 indicating the shape of the first image G1 on the projection surface SC. Note that the information indicating the shape of the first image G1 in the first shape information DS1 may be information for each position of the first image G1 moving on the projection surface SC or information for each capture by the imaging device 17, but may also include information obtained by interpolating the shape of the first image G1 at a position where no image is captured using linear interpolation, etc., as necessary.

[0099] As described above, in step S21, information indicating the relationship between the position and shape of the first image G1 due to the lens shift function is obtained as first shape information DS1. Then, in step S61, for example, after the position of the first image G1 on the projection surface SC is determined based on the first information D1, the current shape of the first image G1 on the projection surface SC is determined based on the relationship between the determined position and the first shape information DS1, and a correction value for geometrically correcting the shape of the first image G1 to offset the determined shape is determined. At this time, a correction value for the blending region R1 is also determined using the third correction information DC3. Information indicating these determined correction values ​​is stored in the storage device 11 as first correction information DC1.

[0100] Similarly, in step S22, information indicating the relationship between the position and shape of the second image G2 due to the lens shift function is obtained as second shape information DS2. Then, in step S62, for example, after the position of the second image G2 on the projection surface SC is determined based on the second information D2, the current shape of the second image G2 on the projection surface SC is determined based on the relationship between the determined position and the second shape information DS2, and a correction value is determined for geometrically correcting the shape of the second image G2 so as to offset the determined shape. Information indicating the correction value thus determined is stored in the storage device 11 as second correction information DC2.

[0101] 9 is an explanatory diagram of how the third correction information DC3 is obtained. In this embodiment, in step S30, the processing device 12 generates the third correction information DS3 using the imaging result of the imaging device 17 in step S20.

[0102] In the first image G1 used in step S21 described above, as shown in FIG. 9, the brightness of the non-overlapping region RN1 is uniform, whereas the brightness of the blending region R1 increases or decreases with increasing distance from the non-overlapping region RN1.

[0103] In step S30, using the captured image obtained by capturing first image G1 with imaging device 17 in step S21, the contours of non-overlapping region RN1 and blending region R1 in the captured image are detected using known image recognition technology. In step S30, based on the results of detecting non-overlapping region RN1 and blending region R1 in this manner, values ​​such as the width, shape, and blend curve of blending region R1 are determined. Information indicating the determined values ​​is stored in storage device 11 as third correction information DC3.

[0104] In the image projection method described above, second information D2 for moving the position of second image G2 on projection surface SC by an amount corresponding to first information D1 is output in step S50, so even if the position of first image G1 on projection surface SC moves, the positional relationship between first image G1 and second image G2 on projection surface SC can be maintained while reducing the user's effort. Also, first correction information DC1 for performing geometric correction on first image G1 according to the position of first image G1 after it has moved is generated based on first shape information DS1 and first information D1 in step S61, so even if the position of first image G1 on projection surface SC moves, by using first correction information DC1, the shape of first image G1 on projection surface SC can be maintained while reducing the user's effort.

[0105] Furthermore, as described above, the second correction information DC2 is generated in step S62, so even if the position of the second image G2 on the projection surface SC moves, by using the second correction information DC2, the shape of the second image G2 on the projection surface SC can be maintained while reducing the user's effort.

[0106] Furthermore, as described above, when the position of the entire image GG is changed, the first correction information DC1 is generated using the third correction information DC3 in step S61, so that even if the entire image GG on the projection surface SC moves, the image quality of the superimposition area R on the projection surface SC can be maintained. Note that when the position of the entire image GG is changed, the processing device 12 may generate the second correction information DC2 using the third correction information DC3 in step S62.

[0107] Furthermore, as described above, the second direction information D2a is output in step S50, so even if the installation attitude of the first projector 10-1 and the installation attitude of the second projector 10-2 are different, the positional relationship between the first image G1 and the second image G2 on the projection surface SC can be maintained.

[0108] Furthermore, as described above, since the second information D2 includes information indicating the first speed, which is the movement speed of the first image G1, the position of the second image G2 on the projection surface SC can be moved at the first speed by referring to the second information D2. As a result, for example, when the first image G1 and the second image G2 are moved simultaneously, the positions of the first image G1 and the second image G2 on the projection surface SC can be moved at the same speed.

[0109] Furthermore, as mentioned above, the first information D1 is information for optically moving the position of the first image G1, or information for electronically moving the position of the first image G1, and therefore the second information D2 or the first correction information DC1 can be generated depending on the information for optically or electronically moving the position of the first image G1.

[0110] 3. Variations The above-described embodiments can be modified in various ways. Specific modifications that can be applied to the above-described embodiments are exemplified below. Two or more embodiments arbitrarily selected from the following examples can be combined as appropriate within the scope of not mutually contradictory.

[0111] 3-1. Variation 1 In the above-described embodiment, an example is given in which the first projector 10-1 controls the operation of the second projector 10-2, but this is not limited to this example. For example, an external device such as a terminal device 30 or a server may control the operation of each of the first projector 10-1 and the second projector 10-2, thereby executing the lens shift function and correction function of each projector 10.

[0112] 3-2. Variation 2 In the above-described embodiment, a blending process is performed, but the present invention is not limited to this. The first blending region R1b and the second blending region R2b may be omitted. In this case, only the positions and shapes of the first image G1 and the second image G2 are corrected.

[0113] 3-3. Variation 3 In the above-described embodiment, the first shape information DS1 and the second shape information DS2 are acquired using the image capturing device 17 of the first projector 10-1, but the present invention is not limited to this. For example, the first shape information DS1 and the second shape information DS2 may be acquired using the image capturing device 17 of the second projector 10-2 instead of or in addition to the image capturing device 17 of the first projector 10-1.

[0114] 3-4. Variation 4 The program PR1 of the above-described embodiment may be provided in a state recorded on a non-transitory computer-readable recording medium. The computer may be, for example, the processing device 12 or the terminal device 30. The program PR1 of the above-described embodiment may also be provided in a form that is downloaded to the computer from a server over a network.

[0115] 4. Notes A summary of this disclosure is provided below.

[0116] (Supplementary Note 1) A first aspect, which is a preferred example of the image projection method of the present disclosure, includes: acquiring in advance first shape information indicating the shape of a first image at each of a plurality of positions on a projection surface when a first projector projects the first image at each of the positions; acquiring first information for moving the position of the first image on the projection surface when a second projector projects a second image at a position on the projection surface where at least a portion of the first image overlaps; outputting second information for moving the position of the second image on the projection surface by an amount of movement corresponding to the first information; and generating first correction information, based on the first shape information and the first information, for performing geometric correction on the first image according to the position of the first image after the movement.

[0117] In the above aspect, since the second information for moving the position of the second image on the projection surface by an amount of movement according to the first information is output, even if the position of the first image on the projection surface moves, the positional relationship between the first image and the second image on the projection surface can be maintained while reducing the effort required by the user. Also, since the first correction information for performing geometric correction on the first image according to the position of the first image after it has moved is generated based on the first shape information and the first information, even if the position of the first image on the projection surface moves, by using the first correction information, the shape of the first image on the projection surface can be maintained while reducing the effort required by the user.

[0118] (Supplementary Note 2) A second aspect, which is a preferred example of the first aspect, further includes: acquiring in advance second shape information indicating the shape of the second image at each of a plurality of positions on the projection surface when the second image is projected from the second projector to each of the positions; and generating second correction information for performing geometric correction on the second image according to the position after the second image has moved, based on the second shape information and the second information. In the above aspect, even if the position of the second image on the projection surface moves, by using the second correction information, it is possible to maintain the shape of the second image on the projection surface while reducing the effort required by the user.

[0119] (Supplementary Note 3) In a third aspect, which is a preferred example of the first or second aspect, the method further includes acquiring in advance third correction information related to correction of an overlapping area between the first image and the second image on the projection surface when a position of an entire image including the first image and the second image is changed, and generating the first correction information using the third correction information. In the above aspect, the image quality of the overlapping area on the projection surface can be maintained even if the entire image on the projection surface moves.

[0120] (Supplementary Note 4) In a fourth aspect which is a preferred example of any of the first to third aspects, the first information includes first direction information indicating a movement direction of the first image based on an installation attitude of the first projector and first attitude information indicating the installation attitude of the first projector, and outputting the second information includes outputting second direction information indicating a movement direction of the second image based on the installation attitude of the second projector based on the first direction information and the first attitude information. In the above aspect, even if the installation attitude of the first projector and the installation attitude of the second projector are different, it is possible to maintain the positional relationship between the first image and the second image on the projection surface.

[0121] (Supplementary Note 5) In a fifth aspect which is a preferred example of any of the first to fourth aspects, when a first speed at which the first projector moves the position of the first image is slower than a second speed which is a maximum speed at which the second projector moves the position of the second image, the second information includes information indicating the first speed. In the above aspect, by referring to the second information, the position of the second image on the projection surface can be moved at the first speed. As a result, for example, when the first image and the second image are moved simultaneously, the positions of the first image and the second image on the projection surface can be moved at the same speed.

[0122] (Supplementary Note 6) In a sixth aspect, which is a preferred example of any of the first to fifth aspects, the first information is either information for optically shifting the position of the first image or information for electronically shifting the position of the first image. In the above aspects, the second information or the first correction information can be generated according to the information for optically or electronically shifting the position of the first image.

[0123] (Appendix 7) A seventh aspect, which is a preferred example of the program of the present disclosure, causes at least one processor to perform the following operations: when a first projector projects a first image at each of a plurality of positions on a projection surface, acquire first shape information in advance that indicates the shape of the first image at each position; when a second projector projects a second image at a position on the projection surface that overlaps with at least a portion of the first image; acquire first information for moving the position of the first image on the projection surface by an amount of movement according to the first information; output second information for moving the position of the second image on the projection surface by an amount of movement according to the first information; and generate first correction information, based on the first shape information and the first information, for performing geometric correction on the first image according to the position of the first image after the movement.

[0124] In the above aspect, since the second information for moving the position of the second image on the projection surface by an amount of movement according to the first information is output, even if the position of the first image on the projection surface moves, the positional relationship between the first image and the second image on the projection surface can be maintained while reducing the effort required by the user. Also, since the first correction information for performing geometric correction on the first image according to the position of the first image after it has moved is generated based on the first shape information and the first information, even if the position of the first image on the projection surface moves, the shape of the first image on the projection surface can be maintained while reducing the effort required by the user.

[0125] (Appendix 8) An eighth aspect, which is a preferred example of the information processing device of the present disclosure, includes at least one processor that executes the following operations: acquiring first shape information in advance, which indicates the shape of a first image at each of a plurality of positions on a projection surface when a first projector projects the first image at each of the positions; acquiring first information for moving the position of the first image on the projection surface when a second projector projects a second image at a position on the projection surface where at least a portion of the first image overlaps; outputting second information for moving the position of the second image on the projection surface by an amount of movement according to the first information; and generating first correction information, based on the first shape information and the first information, for performing geometric correction on the first image according to the position of the first image after the movement.

[0126] In the above aspect, since the second information for moving the position of the second image on the projection surface by an amount of movement according to the first information is output, even if the position of the first image on the projection surface moves, the positional relationship between the first image and the second image on the projection surface can be maintained while reducing the effort required by the user. Also, since the first correction information for performing geometric correction on the first image according to the position of the first image after it has moved is generated based on the first shape information and the first information, even if the position of the first image on the projection surface moves, the shape of the first image on the projection surface can be maintained while reducing the effort required by the user. [Explanation of symbols]

[0127] 10...projector, 10-1...first projector, 10-2...second projector, 11...storage device, 12...processing device, 12a...projection control unit, 12b...imaging control unit, 12c...correction unit, 13...communication device, 14...image processing circuit, 15...optical device, 15a...light source, 15b...light modulator, 15c...projection optical system, 16...operation device, 17...imaging device, 18...sensor, 30...terminal device, 100...system, BR1...brightness, BR2...brightness, D1...first information, D1a...first direction information, D1b...first attitude information, D2...second information, D2a...second direction information, D2b...first velocity information, DC1...first correction information, DC2...second correction information, DC3...third correction information, DR...direction, DS1...first shape information, DS2...second shape information, DS3...third correction Positive information, G1...first image, G2...second image, GG...entire image, IMG1...video data, IMG2...video data, P1-a...position, P1-b...position, P2-a...position, P2-b...position, PC...center, PR1...program, PR2...program, R...overlapping area, R1...blending area, R1b...first blending area, R2...blending area, R2b...second blending area, RF...empty area, RN1...non-overlapping area, RN2...non-overlapping area, RP1...projectable area, RP2...projectable area, S10...step, S20...step, S21...step, S22...step, S30...step, S40...step, S50...step, S60...step, S61...step, S62...step, S70...step, SC...projection surface, α...range.

Claims

1. acquiring in advance first shape information indicating a shape of the first image at each of a plurality of positions on a projection surface when the first image is projected from a first projector at each of the positions; acquiring first information for moving a position of the first image on the projection surface when a second projector projects a second image at a position where the second image overlaps with at least a portion of the first image on the projection surface; outputting second information for moving the position of the second image on the projection surface by an amount of movement according to the first information; generating first correction information for performing geometric correction on the first image according to the position of the first image after movement, based on the first shape information and the first information; Image projection method.

2. acquiring in advance second shape information indicating a shape of the second image at each position when the second image is projected from the second projector onto each of a plurality of positions on the projection surface; generating second correction information for performing geometric correction on the second image according to the position of the second image after movement, based on the second shape information and the second information, The image projection method according to claim 1 .

3. further comprising acquiring in advance third correction information related to correction of an overlapping area of ​​the first image and the second image on the projection surface when a position of an entire image including the first image and the second image is changed; generating the first correction information using the third correction information; 3. The image projection method according to claim 1 or 2.

4. The first information is first direction information indicating a movement direction of the first image based on an installation attitude of the first projector; first attitude information indicating an installation attitude of the first projector, outputting the second information includes outputting second direction information indicating a movement direction of the second image based on an installation attitude of the second projector, based on the first direction information and the first attitude information; 3. The image projection method according to claim 1 or 2.

5. When a first speed at which the first projector moves the position of the first image is slower than a second speed that is a maximum speed at which the second projector moves the position of the second image, the second information includes information indicating the first speed.

3. The image projection method according to claim 1 or 2.

6. the first information is either information for optically moving the position of the first image or information for electronically moving the position of the first image; 3. The image projection method according to claim 1 or 2.

7. acquiring in advance first shape information indicating a shape of the first image at each of a plurality of positions on a projection surface when the first image is projected from a first projector at each of the positions; acquiring first information for moving a position of the first image on the projection surface when a second projector projects a second image at a position where the second image overlaps with at least a portion of the first image on the projection surface; outputting second information for moving the position of the second image on the projection surface by an amount of movement according to the first information; generating first correction information for performing geometric correction on the first image according to the position of the first image after the movement, based on the first shape information and the first information; program.

8. acquiring in advance first shape information indicating a shape of the first image at each of a plurality of positions on a projection surface when the first image is projected from a first projector at each of the positions; acquiring first information for moving a position of the first image on the projection surface when a second projector projects a second image at a position where the second image overlaps with at least a portion of the first image on the projection surface; outputting second information for moving the position of the second image on the projection surface by an amount of movement according to the first information; generating first correction information for performing geometric correction on the first image according to the position of the first image after movement, based on the first shape information and the first information; at least one processor executing Information processing device.

Images