Generation method, computer program, and generation device

Abstract

In the present invention, adjustment data for performing geometric correction for a projection device is generated in advance. In this generation method, a processor: generates image data representing a virtual three-dimensional space obtained by simulating a real space, in which video content is projected by a projection device, and displays the image data on a display; receives, via an input device, designation of a virtual content area indicating a region in which a video is desired to be projected by a virtual projection device, on the image data displayed on the display; sets, on the image data, a virtual content outline including the virtual content area and indicating a region in which the video can be projected by the virtual projection device; and obtains the position of the projection device in the real space at which the video can be projected onto the content outline of the real space corresponding to the virtual content outline, and adjustment data for performing geometric correction so that the projection device projects the video content onto the content outline of the real space in the real space.

Description

Generation method, computer program, and generation device

[0001] The present disclosure relates to a generation method, a computer program, and a generation device that generate adjustment data for adjusting a projection device that projects an image onto a projection surface.

[0002] In recent years, projection devices have been used in various scenarios. However, it is difficult to use a projection device immediately after installation. For example, after installing a projection device, alignment of the projection device may be required. Also, geometric correction of the projection device may be necessary. In addition, the variations of the projection surface for projecting an image are increasing, and it is not limited to a flat projection surface. For example, it may also project onto a curved object or an object with irregularities.

[0003] In order to adjust the image projected by a projection device, a method is used in which an image projected by the projection device is captured using a photographing device, and the adjustment is performed using the captured image (see, for example, Patent Document 1).

[0004] International Publication No. 2013 / 038656

[0005] By the way, when projecting onto a projection surface other than a flat surface by a projection device, the adjustment of the projection device such as geometric correction becomes more complicated.

[0006] The present disclosure provides a generation method, a computer program, and a generation device that generate adjustment data for facilitating adjustment in a projection device.

[0007] The generation method of this disclosure uses a processor to generate adjustment data used for geometric correction of a projection device. The processor is connected to a display and an input device. The generation method generates image data representing a virtual three-dimensional space that simulates the real space on which video content is projected by the projection device, using the processor, and displays it on the display. The input device receives a specification of a virtual content area on the image data displayed on the display, indicating the range on which the virtual projection device is to project video. The method sets a virtual content outline on the image data that encompasses the virtual content area and indicates the range on which the virtual projection device can project video. The method obtains the position of the projection device in the real space on which it can project video onto the content outline in the real space corresponding to the virtual content outline, and adjustment data for geometrically correcting the projection device so that it projects video content onto the content outline in the real space.

[0008] These general and specific embodiments may be implemented by systems, methods, and computer programs, or combinations thereof.

[0009] The generation method, computer program, and generation system disclosed herein can facilitate the generation of adjustment data used for geometric correction and other adjustments during projection by a projection device.

[0010] This is a conceptual diagram showing the areas used by the generation device relating to this disclosure. This is a schematic diagram of a projection system that uses adjustment data generated by the generation device relating to this disclosure. This is a block diagram showing the configuration of the generation device relating to this disclosure. This shows an example of display data generated by the generation device. This shows an example of specifying a content area on the display data. This shows an example of a content area specified in Figure 5B. This shows an example of a content area shown on the display data. This shows an example of a content outline being set from the display data in Figure 6A. This shows an example of a content area being shown on the display data. This shows an example of a content outline being set from the display data in Figure 7A. This shows an example of the position of the projection device being calculated after the content outline has been set. This is a schematic diagram explaining the geometric correction of the projection device. This is a flowchart explaining the generation method relating to this disclosure.

[0011] This disclosure provides a generation method, a computer program, and a generation system that facilitate the generation of adjustment data used for geometric correction and other adjustments during projection by a projection device.

[0012] Embodiments of this disclosure will be described below with reference to the drawings as appropriate. However, unnecessary parts of the description of the prior art and substantially identical configurations may be omitted in the detailed description. This is for the sake of simplicity. Furthermore, the following description and accompanying drawings are disclosed so that a person skilled in the art can fully understand this disclosure and are not intended to limit the subject matter of the claims.

[0013] The generation device according to this embodiment can perform a 3D simulation in advance when installing a projection device, and generate data that can be used when the projection device utilizes the image. For example, it can determine a suitable position for installing the projection device before installing it on site. It can also generate data to be used for geometric correction before setting up the projection device on site. Furthermore, it can determine a suitable position for installing a camera that photographs the projection state of the projection device, which is used for geometric correction, etc., before installing the projection device on site. As a result, even if the area onto which the projection device projects an image is a complex three-dimensional shape that is not flat, performing a 3D simulation before installing the projection device makes it easier to make adjustments after installation. Below, a projection system including a projection device will be described using Figure 2, and then the generation device according to this embodiment will be described.

[0014] First, we define the various terms used in this specification. "Content area" refers to the area where video content is to be projected by a projection device such as a projector. Figure 1 shows an example of a content area 501. The content area 501 is not limited to a flat, rectangular screen. The content area 501 may be, for example, a curved surface. Furthermore, the content area 501 may be a three-dimensional object with uneven surfaces in part or entirely.

[0015] "Geometric correction" refers to corrections related to geometric distortions that occur when an image is projected from a projection device onto a projection surface. For example, geometric correction can correct trapezoidal distortion, barrel distortion, pincushion distortion, and display distorted images as rectangular images. Trapezoidal distortion occurs when an image that should be rectangular is projected as a trapezoid onto the projection surface. Barrel distortion occurs when the center of an image appears to bulge. Pincushion distortion occurs when the center of an image appears to contract. Geometric correction is achieved by adjusting parameter values ​​in the projection device.

[0016] The "projection area before geometric correction" is the range of the image projected onto the projection surface by the projection device before the projection device undergoes geometric correction. Figure 1 shows an example of the projection area 500 before geometric correction. In order to project the desired content image onto the content area 501, the projection device performs adjustments such as geometric correction.

[0017] The "content outline" is the area on which the projection device can project an image. Figure 1 shows an example of a content outline 502. Hereinafter, the rectangle on which the projection device projects an image after the geometric correction described above is referred to as the content outline 502. That is, before geometric correction, the projection device projects an image onto the projection area 500 before geometric correction, but by performing geometric correction, it is possible to project an image without distortion within the range of the content outline 502. In the projection system 1 according to this disclosure, as shown in Figure 1, the content outline 502 is set to encompass the content area 501. This makes it possible to project video content onto the entire content area 501.

[0018] "Three-dimensional spatial data" is data that can reproduce a three-dimensional space, including the projection surface on which the projection device is placed and the video content is projected, as a virtual three-dimensional model. Three-dimensional spatial data can be generated by, for example, a combination of primitives, photogrammetry, 3D point cloud scanning, CAD tools, modeling software, etc. Here, a combination of primitives is a method of generating space by combining basic three-dimensional shapes such as cuboids, spheres, cylinders, and planes. For example, three-dimensional spatial data can include the size, including the area and shape of the space, the shape and size of objects present in the space, and the placement of those objects. Furthermore, if members such as columns or beams exist in the space, the three-dimensional spatial data can include the shape, size, and placement of these parts. In addition, the three-dimensional spatial data can include the size and position of the screen and / or object on which the video content is projected.

[0019] <Projection System> As shown in Figure 2, the projection system 1 includes a projection device 20, a shooting device 30, and a control device 40. The projection device 20, the shooting device 30, and the control device 40 are connected via a network 50. The projection system 1 may also include the projection device 20 according to this disclosure, as shown in Figure 2.

[0020] The projection device 20 is a projector that projects video content onto a projection surface. Specifically, the projection device 20 projects video content into an area designated as the content area.

[0021] The imaging device 30 captures an image as a captured image that includes at least the projected image projected by the projection device 20. Figure 2 shows an example of the region 503 of the captured image captured by the imaging device 30.

[0022] The control device 40 controls the projection of video content by the projection device 20. Before actually projecting the video content, the control device 40 performs adjustments such as geometric correction using adjustment data generated by the generation device 10, which will be described later. By performing adjustments using pre-generated adjustment data, the projection device 20 reduces the time required for on-site installation and adjustment, and enables easy projection of video content. The control device 40 can be implemented using a general personal computer, media processor, media server, or a combination thereof.

[0023] <Generation device> As shown in Figure 3, the generation device 10 according to this disclosure is an information processing device that includes an arithmetic circuit 11, an input device 12, an output device 13, a communication circuit 14, and a storage device 15, etc.

[0024] The arithmetic circuit 11 is a controller that oversees the control of the entire generation device 10. For example, the arithmetic circuit 11 reads and executes the generation program P stored in the memory device 15, thereby realizing various processes for generating adjustment data. The arithmetic circuit 11 may be a CPU, MPU, GPU, FPGA, DSP, ASIC, or other type of processor or a specially designed hardware circuit.

[0025] The input device 12 may be an operation button, keyboard, mouse, touch panel, microphone, etc., used for operation and data input. The output device 13 may be a display that shows image data etc. used in the generation process.

[0026] The communication circuit 14 performs data communication with an external device (for example, a control device 40). The data communication is wired and / or wireless and follows known communication standards. For example, wired data communication may be performed by using a communication controller of a semiconductor integrated circuit that operates in accordance with the Ethernet® standard and / or the USB® standard as the communication circuit 14. Wireless data communication may be performed by using a communication controller of a semiconductor integrated circuit that operates in accordance with the IEEE 802.11 standard for LAN (Local Area Network) and / or the so-called 4G / 5G, or fourth-generation / fifth-generation mobile communication systems, as the communication circuit 14.

[0027] The storage device 15 is a recording medium that stores various types of information. The storage device 15 can be implemented as, for example, RAM, ROM, flash memory, SSD (Solid State Drive), hard disk drive, or other storage devices, or a combination thereof as appropriate. The storage device 15 stores the generation program P, which is a computer program executed by the arithmetic circuit 11, and various data used to generate adjustment data. For example, the storage device 15 stores three-dimensional spatial data 151, image data 152, generated adjustment data 153, etc.

[0028] The generation device 10 may be implemented by a plurality of information processing devices that are connected to each other in a manner that enables communication. Furthermore, some of the data stored in the storage device 15 may be stored in an external storage device, and the generation device 10 may be configured to read and use the data from the external storage device.

[0029] The 3D spatial data 151 is data that can reproduce the 3D space, including the projection surface onto which the video content is projected, as a virtual 3D model.

[0030] Image data 152 is data representing a virtual three-dimensional space that simulates the space on which the video content is projected, generated using three-dimensional spatial data 151. Image data 152 is generated by the generation device 10.

[0031] The adjustment data 153 is data used to adjust the projection device 20. The adjustment data 153 may include data indicating the installation position of the projection device 20. The adjustment data 153 may also include geometric correction data used for geometric correction of the projection device 20 calculated by the generation device 10. The geometric correction data includes data related to various parameters of the projection device 20.

[0032] The setting data 154 is data such as various parameters set by the projection device 20 after initial adjustments have been completed and projection has started. The generation device 10 can use the setting data 154 as data necessary for maintenance and readjustment of the projection device 20.

[0033] The arithmetic circuit 11 performs processes such as generating image data, receiving content area specifications, setting content outlines, calculating the position of the projection device, calculating geometric correction data, calculating non-overlapping areas, generating adjustment data, processing various changes, providing adjustment data, and acquiring setting data.

[0034] 《Image Data Generation Process》 The arithmetic circuit 11 reads 3D spatial data 151 from the storage device 15 and reproduces a 3D model. The 3D model is data that simulates the space on which video content is projected by the projection device 20. The arithmetic circuit 11 generates image data 152 that represents a virtual 3D space as a 3D model. The arithmetic circuit 11 stores the generated image data 152 in the storage device 15. Figure 4 shows an example of image data 152. Figure 4 is an example of image data 152 showing a 3D model in which an object including a curved surface is placed in a part of a rectangular space.

[0035] 《Processing of Receiving Designation of Content Area》 When the arithmetic circuit 11 displays the image data 152 on the output device 13, it receives the designation of a virtual content area 501v from the user on the image data 152. The designation of the virtual content area 501v is input to the arithmetic circuit 11 by the user through the input device 12.

[0036] Figure 5A shows an example of image data 152 in which a virtual content area 501v is specified by the user. In the example shown in Figure 5A, the curved surface of an object placed in space is specified as the virtual content area 501v on the 3D model. In this case, the user uses the input device 12 to select the surface to be specified as the virtual content area 501v on the image data 152 displayed on the output device 13. In Figure 5A, the selected surface is shown as a dashed rectangle. For example, by selecting a part of the surface to be used as the virtual content area 501v, the entire selected surface on the image data 152 is specified as the virtual content area 501v, as shown in Figure 5B.

[0037] The designation of the virtual content area 501v is not limited to the method described above using Figure 5A. For example, the outer frame of the virtual content area 501v may be designated on the image data 152 via the input device 12. Alternatively, the entire virtual content area 501v may be designated on the image data 152 by filling it in using the input device 12.

[0038] 《Content Outline Setting Process》 When a virtual content area 501v is specified on the image data 152, the calculation circuit 11 sets the virtual content outline 502v. The virtual content outline 502v is set automatically or manually.

[0039] Figures 6A and 6B illustrate an example of image data 152 in which a virtual content outline 502v is set. Figure 6A shows an example of image data 152 that includes a specified virtual content area 501v. In Figure 6A, the rectangle shown by the dashed line is the virtual content area 501v. In the example shown in Figure 6A, the virtual content area 501v is a rectangle on a plane. Thus, when the virtual content area 501v is a rectangle on a plane, the virtual content outline 502v can be the same as the virtual content area 501v, as shown in Figure 6B.

[0040] Figures 7A and 7B illustrate other examples of image data 152 in which a virtual content outline 502v is set. Figure 7A is an example of image data 152 containing a specified virtual content area 501v. In Figure 7A, the area enclosed by the dashed line is the virtual content area 501v. In the example shown in Figure 7A, the virtual content area 501v is a curved surface. Thus, when the virtual content area 501v is not a rectangle on a plane, the virtual content outline 502v can be the area containing the virtual content area 501v. Therefore, as shown in Figure 7B, the area encompassing the virtual content area 501v is set as the virtual content outline 502v.

[0041] When manually setting the virtual content outline 502v, the user uses the input device 12 to specify the area containing the virtual content area 501v on the image data 152 displayed on the output device 13. For example, the user may use the input device 12 to draw the outer frame of the virtual content area 501v on the image data.

[0042] 《Process for calculating the position of the projection device》 When a virtual content outline 502v is set on the image data 151, the calculation circuit 11 calculates the placement position of the virtual projection device 20v in the virtual three-dimensional space indicated by the image data 151. The placement position of the virtual projection device 20v is the position in the three-dimensional space in which the virtual projection device 20v can project an image into the range that includes the virtual content outline 502v.

[0043] Based on the premise that the projection area of the projection device 20 can enclose the content outline, the arithmetic circuit 11 can determine the position of the projection device 20. Here, the arithmetic circuit 11 can obtain the position of the virtual projection device in the virtual three-dimensional space based on the type number of the projection device 20 and the lens built in the projection device 20. Specifically, the arithmetic circuit 11 can obtain the virtual projection area in the virtual three-dimensional space according to the specifications of the projection device 20 (for example, the aspect ratio), the specifications of the lens (for example, the focal length), and the distance between the lens and the projection plane. The specifications of the projection device 20 can be specified from the type (type number) of the projection device 20. The specifications of the lens can be specified from the type number of the lens.

[0044] When the arithmetic circuit 11 obtains the virtual projection area in the virtual three-dimensional space, it generates image data 152 that represents the obtained virtual projection area in the three-dimensional space. In addition, the arithmetic circuit 11 displays the generated image data 152 on the output device 13. While viewing the image data 152 displayed on the output device 13, the user adjusts the position of the virtual projection device in the virtual three-dimensional space via the input device 12. The arithmetic circuit 11 can determine the position of the virtual projection device according to the operation signal received via the input device 12. In addition, the arithmetic circuit 11 determines the position of the actual projection device 20 using the position of the virtual projection device in the three-dimensional space.

[0045] Note that by specifying the installation conditions of the projection device 20 (for example, the size of the room where the projection device is installed, the rotation direction of the projection device 20, the type of the lens, the brightness, the resolution, the number of units used, etc.), the installable range of the projection device 20 is limited. Therefore, the arithmetic circuit 11 can narrow down the installable range of the virtual projection device 20 in the three-dimensional space according to these conditions. In addition, the arithmetic circuit 11 generates image data 152 including the virtual projection device based on a predetermined position (for example, the center, etc.) obtained from the narrowed-down range. After that, when the arithmetic circuit 11 receives an operation signal for moving the position of the virtual projection device from the user via the input device on the image data 152, it determines the position of the projection device 20 in the real space according to the received operation signal.

[0046] FIG. 8 shows an example in which a virtual projection device 20v projects an image onto a virtual content area 501v on the image data 152. When determining the position of the virtual projection device 20v, geometric correction of the virtual projection device 20v is not performed. Therefore, as shown in FIG. 8, the position of the virtual projection device 20v is calculated so that the projection area 500v before virtual geometric correction includes the virtual content outline 502v set in the previous process. The arithmetic circuit 11 calculates the position of the projection device 20 in the real space using the position of the virtual projection device 20v in the virtual three-dimensional space calculated here.

[0047] 《Calculation Process of Geometric Correction Data》 When the position of the projection device 20 is calculated, the arithmetic circuit 11 calculates geometric correction data for performing geometric correction of the projection device 20. For example, as shown in FIG. 9, geometric correction data for performing geometric correction is generated so that the coordinates of each of the arbitrary points P1 to P4 of the projection area 500v before virtual geometric correction move to the coordinates of the corresponding points P21 to P24 of the virtual content outline 502v.

[0048] Existing methods can be used for geometric correction. For example, a coordinate conversion table may be used as described in Japanese Unexamined Patent Application Publication No. 2023-132946. Specifically, the arithmetic circuit 11 creates image data 152 in which a predetermined pattern image is projected by the virtual projection device 20v on a three-dimensional model (virtual three-dimensional space). Here, the predetermined pattern image includes coordinate information. Further, the arithmetic circuit 11 creates a virtual captured image obtained by capturing the state displayed by the virtual imaging device 30v. Then, the arithmetic circuit compares the original pattern image with the pattern image virtually projected to generate a coordinate conversion table. The coordinate conversion table thus generated is used as geometric correction data. Alternatively, the user may change the parameters of the projection device 20 via the input device 12 to be used as geometric correction data.

[0049] In this way, the arithmetic circuit 11 can obtain a coordinate transformation table between the coordinate system of the virtual camera and the coordinate system of the virtual projection device. For example, the arithmetic circuit 11 specifies the coordinates of the four corners (P21 to P24) of the content outline in the image captured by the virtual camera and generates a coordinate transformation table that transforms them into the coordinates of the virtual projection device. By using the coordinate transformation table generated in this way, the arithmetic circuit 11 can transmit the shape of the image to be projected after geometric correction to the projection device 20. At this time, for example, the arithmetic circuit 11 generates a parameter that corresponds the coordinates of the image to be projected by the projection device 20 to the coordinates of the projection area. The parameter may be a vector containing multiple parameters. In this case, the vector may be a homography matrix generated by homography transformation. Alternatively, the arithmetic circuit 11 may generate a parameter that corresponds the coordinates of the virtual camera to the coordinates of the projection area projected in real space. This parameter may also be a vector containing multiple parameters.

[0050] 《Calculation Process for Non-Overlapping Regions》 Once the virtual content area 501v and virtual content outline 502v are determined, the arithmetic circuit 11 calculates a virtual non-overlapping region from the virtual content outline 502v where the virtual content area 501v is not superimposed. In the example shown in Figure 1, the shaded area is the virtual non-overlapping region 504. When the projection device 20 projects video content, it is decided that light will not be projected onto the pixels of this non-overlapping region 504. Specifically, the arithmetic circuit 11 sets the pixel value of the non-overlapping region 504 to 0 (black). This allows the projection device 20 to project video only onto the content area 501. Therefore, the arithmetic circuit 11 generates an operation signal that sets the pixel value of the non-overlapping region 504 to 0. At this time, the arithmetic circuit 11 calculates the non-overlapping region 504 in real space after determining the virtual non-overlapping region in the virtual 3D model.

[0051] <Process for generating adjustment data> The arithmetic circuit 11 generates adjustment data 153 that includes various calculated data. The arithmetic circuit 11 stores the generated adjustment data 153 in a memory device. The adjustment data 153 is used to adjust the projection device 20. For example, the adjustment data 153 may include geometric correction data. The adjustment data 153 may also include operation signals that set the pixel values ​​of the non-overlapping region 504 to 0.

[0052] Furthermore, when the generation device 10 is capable of simulating the lens shift of the projection device 20, the adjustment data 153 may include control signals for the lens shift amount and zoom amount. In addition, when the projection system 1 includes multiple projection devices 20, as will be described later in a modified example, the adjustment data 153 may include control signals for blending images projected from adjacent projection devices 20.

[0053] 《Processing of various changes》 When the arithmetic circuit 11 receives a request signal to change the position of the virtual content outline 502v, the virtual projection device 20v, etc. on the image data 152, it performs various processes according to the received request signal to execute the change.

[0054] <Processing of providing adjustment data> The calculation circuit 11 can provide the generated adjustment data 153 to the control device 40 via the network 50. This allows the control device 40 to use the adjustment data 153 generated by the simulation performed by the generation device 10 to perform initial adjustments such as geometric correction of the projection device 20.

[0055] <Setting Data Acquisition Process> After the control device 40 adjusts the projection device 20, the calculation circuit 11 can acquire setting data 154 from the control device 40, which includes various parameters set in the projection device 20. This allows the generation device 10 to generate adjustment data necessary for readjusting the projection device 20 during maintenance. Using the generated adjustment data, for example, (i) to (iv) described below can be realized.

[0056] (i) Verification of the effective range of the correction function The projection correction function of the projection device 20 ensures that the content area is not shifted by pre-allocating an extra content outline and correcting any slight shift in the outline with geometric correction (see, for example, Japanese Patent Application Publication No. 2018-207373). To realize this correction function, the projection area of ​​the projection device 20 captured by the shooting device 30 is used. Specifically, using a virtual captured image, it is possible to simulate in advance how much of the content outline should be left over, and what the optimal virtual shooting device installation position is when considering the shift. (ii) Verification of the validity of the simulation and the position of the shooting device The setting data 154 obtained on site can be compared with the setting data obtained in the prior simulation to verify the validity of the simulation or to reconsider the position of the shooting device 30. This makes it easier to set up the projection device 20 on site by comparing the setting data 154 obtained on site with the setting data obtained in the simulation.

[0057] (iii) Correction without using captured images In the example described in (ii), the setting data of a virtual projection device and an image containing the virtual projection area captured by a virtual camera are used. Instead of an image containing the virtual projection area captured by a virtual camera, it is possible to acquire and use 3D spatial information of the actual site, which allows calculations to be performed under simulation conditions that are more faithful to reality. Geometric correction data in the virtual 3D space calculated in this way may be generated and used in the actual projection device.

[0058] (iv) Predicting changes over time By preparing physical models of the weight and fastening hardware of the projection device 20 and setting external environmental conditions such as vibrations at the installation site, it becomes possible to perform simulations using physical calculations. This makes it possible to propose appropriate timing for correcting the projection misalignment function of the projection device 20 over time and for correcting the misalignment of the main unit.

[0059] (v) Backup of setting data The setting data itself that was set on the projection device 20 during the initial adjustment may be lost for some reason. By backing up the setting data 154 on another medium (for example, the storage device 15 of the generation device 10) during the initial setup, the setting data used by the projection device 20 can be restored.

[0060] <Generation Method> The generation method according to this disclosure will be explained using the flowchart shown in Figure 10. First, the arithmetic circuit 11 reads the three-dimensional spatial data 151 from the storage device 15 (S001).

[0061] Furthermore, the arithmetic circuit 11 generates image data 152 using the three-dimensional spatial data 151 read in step S001 (S002). The image data 152 represents a virtual three-dimensional space that simulates the space on which the video content is projected by the projection device.

[0062] Next, the arithmetic circuit 11 displays the image data 152 generated in step S002 on the output device 13 (S003).

[0063] The arithmetic circuit 11 accepts the specification of a content area (S004). Specifically, it accepts the specification of a virtual content area 501v on the image data 152 displayed on the output device 13 via the input device 12.

[0064] Furthermore, the arithmetic circuit 11 sets the content outline (S005). For example, the arithmetic circuit 11 may set a specified range on the image data 152 displayed on the output device 13 via the input device 12 as a virtual content outline 502v.

[0065] Subsequently, the calculation circuit 11 calculates the position in the virtual three-dimensional space where the virtual projection device 20v should be placed so that the video content is projected onto the virtual content outline 502v set in step S005. The calculation circuit 11 also uses the calculated position of the virtual projection device 20v to calculate the position of the projection device 20 in the real space (S006).

[0066] Next, the calculation circuit 11 calculates geometric correction data to geometrically correct the projection device 20 so that the projection device 20 can project video content onto the content outline 502 (S007).

[0067] Furthermore, the arithmetic circuit 11 calculates a virtual non-overlapping region between the virtual content outline 502v and the content area 501v. The arithmetic circuit 11 also uses the virtual non-overlapping region 504v to determine the non-overlapping region 504 in real space (S008).

[0068] Furthermore, the calculation circuit 11 calculates the position of a virtual camera 30v capable of capturing an image, including the state in which the virtual projection device 20v is projecting an image. The calculation circuit 11 also calculates the position of the real camera 30 from the position of the virtual camera (S009).

[0069] The calculation circuit 11 generates adjustment data 153 that includes the geometric correction data obtained in step S007 and the non-overlapping region acquired in step S008 (S010).

[0070] When the arithmetic circuit 11 receives a change in the position of the virtual content outline 502v on the image data 152, it returns to step S005, sets a new virtual content outline 502v according to the received change, and repeats the processing in steps S006 to S010 (YES in S011, S012).

[0071] If the position of the virtual content outline 502v does not change, the calculation circuit 11 uses the adjustment data 153 generated in step S010 when setting up the projection device 20 later (YES in S011).

[0072] As described above, the generation device 10 according to the embodiment can generate adjustment data 153 to be used for setting up the projection device 20 by utilizing a three-dimensional simulation before installing the projection device 20 in a real space. Therefore, when installing the projection device 20 in a real space, the user can easily perform geometric corrections, etc., using the adjustment data 153. Furthermore, by acquiring setting data 154 from the control device 40, the generation device 10 can also easily generate adjustment data 153 to be used for maintenance of the projection device 20, etc.

[0073] <Modification> The projection system 1 described above using Figure 2 was explained as an example having one projection device 20. The same applies to the case of a projection system 1 having multiple projection devices 20. When the projection system 1 has multiple projection devices 20, the generation device 10 generates adjustment data for each projection device 20. When the projection system 1 has multiple projection devices 20, the calculation circuit 11 executes the process of receiving the content area specification (S004) to calculating the non-overlapping area (S008) shown in the flowchart of Figure 10 for each projection device 20.

[0074] 《Outline of Embodiments》 (1) The generation method of the present disclosure is a generation method that uses a processor to generate adjustment data used for geometric correction of a projection device, wherein the processor is connected to a display and an input device, the processor generates image data representing a virtual three-dimensional space that simulates the real space on which video content is projected by the projection device and displays it on the display, the input device receives a specification of a virtual content area on the image data displayed on the display that indicates the range on which the virtual projection device is to project video, and sets a virtual content outline on the image data that encloses the virtual content area and indicates the range on which the virtual projection device can project video, The position of the projection device capable of projecting an image onto the content outline in the real space corresponding to the virtual content outline in the real space, and parameters that correlate the coordinate system of the virtual projection device with the coordinate system on which the image is projected in the virtual three-dimensional space, are determined as geometric correction adjustment data.

[0075] This allows the generation device to use adjustment data generated in advance through 3D simulation, making it easier to adjust the projection device, such as correcting its geometry.

[0076] (2) In (1), the processor is connected to a storage device that stores three-dimensional spatial data representing a virtual three-dimensional space that simulates the real space, and the processor may read the three-dimensional spatial data from the storage device and generate the image data.

[0077] This allows 3D spatial data stored in a memory device to be used in 3D simulations.

[0078] (3) In any of (1) to (2), the designation of the virtual content area may be performed by specifying predetermined coordinates that indicate the virtual content area on the image data.

[0079] This allows users to easily specify content areas.

[0080] (4) In any one of (1) to (3), the setting of the virtual content outline may be performed by specifying a rectangular area on the image data that encloses the virtual content area through an operation via the input device.

[0081] This allows the user to specify the content outline to a desired area through their actions.

[0082] (5) In any one of (1) to (4), the processor may accept a change in the installation position of the projection device on the image data by operation via the configured input device, obtain a virtual content outline corresponding to the changed installation position, and superimpose it on the image data.

[0083] This allows the content outline to change according to the projection device's position when the projection device's position is changed.

[0084] (6) In any one of (1) to (5), the processor may superimpose the virtual content outline onto the image data displayed on the display, and when it receives a request via the input device to change the virtual content outline on the image data displayed on the display, it may update the adjustment data so that the projection device projects the video content onto the actual content outline corresponding to the virtual content outline changed by the request.

[0085] This allows you to update adjustment data when you change the content outline.

[0086] (7) In any one of (1) to (6), the processor may determine, by operation via the input device, a position in the virtual three-dimensional space for arranging a virtual shooting device capable of shooting video content projected by the virtual projection device.

[0087] This makes it easy to set the position of the imaging device when using an imaging device to control the projection device.

[0088] (8) In any one of (1) to (7), the processor determines each pixel that is outside the content area but inside the content outline, and the adjustment data may include a signal that causes each of the pixels to be displayed with a predetermined pixel value.

[0089] This allows the image to be projected only into the content area.

[0090] (9) In any one of (1) to (8), the parameter which is the adjustment data may be a vector containing multiple parameters.

[0091] This allows the desired geometric correction to be performed.

[0092] (10) A computer program that causes a processor to perform one of the methods (1) through (9).

[0093] This makes it easier to adjust the projection device, such as by using adjustment data generated in advance through 3D simulation, to correct its geometry.

[0094] (11) The present invention provides a generator for generating geometric correction data used for geometric correction of a projection device, comprising a processor connected to a display and an input device, wherein the processor generates image data representing a virtual three-dimensional space that simulates the real space on which video content is projected by the projection device and displays it on the display, receives a designation of a virtual content area on the image data displayed on the display via the input device that indicates the range on which video is to be projected by the virtual projection device, sets a virtual content outline that encompasses the virtual content area and indicates the range on which the virtual projection device can project video, obtains parameters as geometric correction adjustment data that associate the coordinate system of the virtual projection device with the coordinate system on which video is projected in the virtual three-dimensional space, such that the position of the projection device in the real space corresponds to the content outline in the real space on which video is to be projected, and parameters that associate the coordinate system of the virtual projection device with the coordinate system on which video is projected in the virtual three-dimensional space, so that the projection device projects video content onto the content outline in the real space.

[0095] This allows the generation device to use adjustment data generated in advance through 3D simulation, making it easier to adjust the projection device, such as correcting its geometry.

[0096] The generation methods, computer programs, and generation apparatus described in all claims of this disclosure are realized through the cooperation of hardware resources, such as a processor, memory, and computer programs.

[0097] The generation method, computer program, and generation apparatus disclosed herein are useful for adjusting, such as geometric correction, a projection device that projects video content.

Claims

1. A generation method for generating adjustment data used for geometric correction of a projection device using a processor, wherein the processor is connected to a display and an input device, the processor generates image data representing a virtual three-dimensional space that simulates the real space on which video content is projected by the projection device and displays it on the display, the processor receives a specification of a virtual content area on the image data displayed on the display via the input device, the virtual content area indicating the range on which video is to be projected by the virtual projection device is to be projected, a virtual content outline is set on the image data that encompasses the virtual content area and indicates the range on which the virtual projection device can project video, and parameters are obtained as geometric correction adjustment data to associate the position of the projection device in the real space on which video can be projected with the content outline in the real space corresponding to the virtual content outline in the real space, and the coordinate system of the virtual projection device with the coordinate system on which video is projected in the virtual three-dimensional space, so that the projection device projects video content onto the content outline in the real space in the real space. Generation method.

2. The generation method according to claim 1, wherein the processor is connected to a storage device that stores three-dimensional spatial data representing a virtual three-dimensional space that simulates the real space, and the processor reads the three-dimensional spatial data from the storage device to generate the image data.

3. The generation method according to claim 1, wherein the designation of the virtual content area is performed by specifying predetermined coordinates that indicate the virtual content area on the image data.

4. The generation method according to claim 1, wherein the setting of the virtual content outline is performed by specifying a rectangular area containing the virtual content area on the image data through an operation via the input device.

5. The generation method according to claim 1, wherein the processor accepts a change in the installation position of the projection device on the image data through an operation via the configured input device, obtains a virtual content outline corresponding to the changed installation position, and superimposes it on the image data.

6. The generation method according to claim 1, wherein the processor superimposes the virtual content outline onto the image data to be displayed on the display, and when it receives a request via the input device to change the virtual content outline on the image data displayed on the display, it updates the adjustment data so that the projection device projects the video content onto the real content outline corresponding to the virtual content outline changed by the request.

7. The generation method according to claim 1, wherein the processor determines, by operation via the input device, the position in the virtual three-dimensional space for arranging a virtual shooting device capable of shooting video content projected by the virtual projection device.

8. The generation method according to claim 1, wherein the processor determines each pixel that is outside the content area but inside the content outline, and the adjustment data includes a signal that causes each pixel to be displayed with a predetermined pixel value.

9. The generation method according to claim 1, wherein the parameter, which is the adjustment data, is a vector containing multiple parameters.

10. A computer program that causes a processor to perform the method according to any one of claims 1 to 9.

11. A generation device for generating geometric correction data used for geometric correction of a projection device, comprising a processor connected to a display and an input device, wherein the processor generates image data representing a virtual three-dimensional space that simulates the real space on which video content is projected by the projection device and displays it on the display, receives a specification of a virtual content area on the image data displayed on the display via the input device that indicates the range on which video is to be projected by the virtual projection device, sets a virtual content outline that encompasses the virtual content area and indicates the range on which the virtual projection device can project video, and obtains parameters as geometric correction adjustment data that associate the position of the projection device on which video can be projected in the real space corresponding to the content outline in the real space with the coordinate system of the virtual projection device and the coordinate system on which video is projected in the virtual three-dimensional space, so that the projection device projects video content on the content outline in the real space.

Images