Adjustment method, adjustment device, and computer program

Abstract

This reduces the time required to adjust the projection positions of multiple projection devices. [Solution] The adjustment method, in a projection system that projects images from multiple projection devices, adjusts the projection area of ​​each projection device using a control device. The control device is connected to each of the projection devices and to a shooting device. The control device includes an arithmetic circuit. The adjustment method uses the arithmetic circuit to cause each projection device to project a predetermined pattern image, acquires a captured image from the shooting device showing the state in which multiple pattern images are projected, detects the area of ​​the pattern image projected by each projection device included in the captured image, sets this as the current projection area of ​​each projection device, generates a control signal to change the projection area of ​​each projection device from the current projection area to a target projection area set for each projection device, and transmits the generated control signal to each projection device.

Description

Technical Field

[0005]

[0001] The present disclosure relates to an adjustment method, an adjustment device, and a computer program for adjusting a projection area by a plurality of projection devices in a projection system that combines a plurality of projection devices to project one video content.

Background Art

[0002] Conventionally, a projection system that projects images from a plurality of projection devices to respective target projection areas has been used. In such a projection system, each projection device may project different frame portions divided from each frame of the content to a specified position. Thereby, the projection system can display one video in a wide projection range by using a plurality of projection devices. Alternatively, in such a system, each projection device may project the same or different videos to respective pre-specified projection areas.

[0003] In such a projection system, the projection area of each projection device is adjusted so that each projection device projects an image to a pre-specified position. Specifically, an adjustment process is executed in which each projection device projects an image to a desired position in order. <000001​​​​​​​​​​​​​​​​​​​​​​​​​​​​However, in the method of adjusting each device sequentially, it is necessary to perform processes such as positional misalignment detection sequentially, and the adjustment time for the projection area increases as the number of projection devices increases.

[0006] The projection system described herein can reduce the time required to adjust the positions in which multiple projection devices project images. [Means for solving the problem]

[0007] The adjustment method of this disclosure, in a projection system that projects images from multiple projection devices, adjusts the projection area of ​​each projection device using a control device. The control device is connected to each of the projection devices and to a shooting device. The control device includes an arithmetic circuit. The adjustment method uses the arithmetic circuit to cause each of the projection devices to project a predetermined pattern image, acquires a captured image from the shooting device showing the state in which multiple pattern images are projected, detects the area of ​​the pattern image projected by each projection device included in the captured image and sets it as the current projection area of ​​each projection device, generates a control signal to change the projection area of ​​each projection device from the current projection area to a target projection area defined for each projection device, and transmits the generated control signal to each projection device.

[0008] Such general and specific embodiments may be implemented by systems, methods, and computer programs, or combinations thereof. [Effects of the Invention]

[0009] The adjustment method, adjustment apparatus, and computer program of this disclosure can reduce the time required to adjust the positions in which multiple projection devices project images. [Brief explanation of the drawing]

[0010] [Figure 1A] This is a schematic diagram showing a projection system according to an embodiment of the present disclosure. [Figure 1B] This is a block diagram showing the configuration of the adjustment device in Figure 1A. [Figure 1C] It is a block diagram showing the configuration of the projection device in FIG. 1A. [Figure 1D] It is a block diagram showing the configuration of the imaging device in FIG. 1A. [Figure 2] It is a flowchart for explaining the adjustment process executed by the adjustment device of the present disclosure. [Figure 3] It is a flowchart for explaining the selection process of the arrangement state executed by the adjustment device of the present disclosure. [Figure 4A] It is an explanatory diagram of arrangement state 1 used in the adjustment device of the present disclosure. [Figure 4B] It is an explanatory diagram of arrangement state 2 used in the adjustment device of the present disclosure. [Figure 4C] It is an explanatory diagram of arrangement state 3 used in the adjustment device of the present disclosure. [Figure 5] It is a flowchart for explaining analysis process 1 of the projection area executed by the adjustment device of the present disclosure. [Figure 6] It is an explanatory diagram for detecting the projection area from the captured image of arrangement state 1. [Figure 7] It is an explanatory diagram for detecting the projection area from the captured image of arrangement state 2. [Figure 8] It is a flowchart for explaining analysis process 2 of the projection area executed by the adjustment device of the present disclosure. [Figure 9A] It is an explanatory diagram of the pattern image masked by the mask image. [Figure 9B] It is a captured image including only the masked pattern image in FIG. 9A. [Figure 9C] It is an explanatory diagram of the pattern image masked by the mask image. [Figure 9D] It is a captured image including only the masked pattern image in FIG. 9C. [Figure 10] It is a captured image including the pattern image in FIG. 9B and the pattern image in FIG. 9D. [Figure 11] It is an explanatory diagram for detecting the first projection area from the captured image in FIG. 10. [Figure 12A] It is an example of the pattern image masked by the mask image. [Figure 12B] Another example of a pattern image masked by a mask image. [Figure 12C] Another example of a pattern image masked by a mask image. [Figure 13] A flowchart for explaining the generation process of an adjustment signal executed by the adjustment device of the present disclosure. [Figure 14] An explanatory diagram for comparing the current projection area and the target projection area. [Figure 15A] A captured image including a plurality of non-overlapping projection areas. [Figure 15B] The first mask image used for the captured image of FIG. 15A. [Figure 15C] The third mask image used for the captured image of FIG. 15A. [Figure 16A] A captured image including a plurality of overlapping projection areas. [Figure 16B] The first mask image used for the captured image of FIG. 16A. [Figure 16C] The third mask image used for the captured image of FIG. 16A.

Embodiments for Carrying Out the Invention

[0011] [Embodiment] Hereinafter, embodiments in the present disclosure will be described with reference to the drawings as appropriate. However, in the detailed description, unnecessary parts of the description regarding the prior art and substantially identical configurations may be omitted for the sake of simplicity. The following description and the accompanying drawings are disclosed so that those skilled in the art can fully understand the present disclosure and are not intended to limit the subject matter of the claims.

[0012] The adjustment method, adjustment apparatus, and computer program relating to this disclosure are used to adjust each projection device in a projection system that combines multiple images displayed by multiple projection devices to project a single video content. Specifically, the adjustment method, adjustment apparatus, and computer program relating to this disclosure can be used to adjust the projection area of ​​the images of multiple projection devices.

[0013] <Projection System> As shown in Figure 1A, the projection system 1 according to this embodiment includes an adjustment device 10, a plurality of projection devices 20A, 20B, a shooting device 30, and a network 40. Each projection device 20A, 20B is controlled by the adjustment device 10 to display a different image, and together they can generate a single video content. In such a projection system 1, the adjustment device 10 can adjust the projection area of ​​each projection device 20A, 20B by adjusting the projection-related parameters of each projection device 20A, 20B.

[0014] In the example shown in Figure 1A, projection system 2 is described as including two projection devices 20A and 20B, but the number of projection devices included in projection system 1 is not limited. Therefore, the number of projection devices adjusted by projection system 1 is also not limited.

[0015] <Adjustment device> As shown in Figure 1B, the adjustment device 10 is an information processing device that includes an arithmetic circuit 11, an input device 12, an output device 13, a communication circuit 14, and a storage device 15. The adjustment device 10 acquires images captured by the imaging device 30, which are displayed on multiple display devices 20A and 20B, and can use the acquired images to adjust the parameters related to the display of each display device 20A and 20B.

[0016] The arithmetic circuit 11 is a controller that oversees the control of the entire adjustment device 10. For example, the arithmetic circuit 11 reads and executes the adjustment program P stored in the memory device 15, thereby realizing various processes related to the adjustment of parameters associated with the display of each display device 20A, 20B. The arithmetic circuit 11 may be a CPU, MPU, GPU, FPGA, DSP, ASIC, or any other type of processor or specially designed hardware circuit.

[0017] The input device 12 is used for user operation and data input. The input device 12 may be, for example, an operation button, keyboard, mouse, touch panel, microphone, etc. The output device 13 is used for outputting processing results and data. The output device 13 may be, for example, an output means such as a display or speaker.

[0018] The communication circuit 14 performs data communication with the display devices 20A and 20B and the imaging device 30. Data communication is performed by wire and / or wirelessly, and follows, for example, known communication standards. For example, wired data communication may be performed by using a communication controller of a semiconductor integrated circuit that operates in accordance with the Ethernet® standard and / or the USB® standard as the communication circuit 14. Wireless data communication may be performed by using a communication controller of a semiconductor integrated circuit that operates in accordance with the IEEE 802.11 standard for wireless LAN (Local Area Network) and / or the so-called 4G / 5G / 6G mobile communication systems, etc., as the communication circuit 14.

[0019] The storage device 15 is a recording medium that stores various types of information. The storage device 15 can be implemented as, for example, RAM, ROM, flash memory, SSD (Solid State Drive), hard disk drive, other storage devices, or a combination thereof as appropriate. The storage device 15 stores the adjustment program P, which is a computer program executed by the arithmetic circuit 11, and various data such as pattern images 151 used for image adjustment.

[0020] The pattern image 151 contains different information for each projection device 20A and 20B. For example, the pattern image 151 may contain characters defined for each projection device 20A and 20B. Specifically, the pattern image 151 for the first projection device 20A may contain the number "1", and the pattern image 151 for the third projection device 20B may contain the number "2". Alternatively, the pattern image 151 may be an image of a different color for each projection device 20A and 20B. Specifically, the pattern image 151 for the first projection device 20A may be a red image, and the pattern image 151 for the third projection device 20B may be a blue image. In addition, the pattern image 151 may contain identification information such as a QR code (registered trademark) defined for each projection device 20A and 20B, or patterns such as stripes with different spacing for each projection device 20A and 20B. Furthermore, the pattern image 151 is not limited to a single still image. For example, the images may have different frame rates for each projection device 20A and 20B. Furthermore, the pattern image 151 may have different blinking counts for each projection device 20A and 20B.

[0021] Furthermore, the pattern image 151 includes coordinate information indicating at least three points. For example, it can be seen that the projection state of the image can be determined if the coordinates of three points set within the image are determined. Therefore, the pattern image 151 includes coordinate information for at least three points.

[0022] <Projection device> Projection devices 20A and 20B project images transmitted from information processing devices such as the adjustment device 10 onto a screen. At this time, each projection device 20A and 20B receives a different image and projects that image onto the corresponding projection area, thereby generating a single video content.

[0023] As shown in Figure 1C, the first projection device 20A includes an arithmetic circuit 21, an input device 22, an output device 23, a communication circuit 24, an HDMI® receiving circuit 25, an HDMI® transmitting circuit 26, a storage device 27, and an optical mechanism 28. The arithmetic circuit 21, input device 22, output device 23, communication circuit 24, and storage device 27 are implemented by the same specific means as the arithmetic circuit 11, input device 12, output device 13, communication circuit 14, and storage device 15 described above using Figure 1B. The HDMI® receiving circuit 25 enables the reception of data from an external device (not shown). The HDMI® transmitting circuit 26 enables the transmission of data to an external device (not shown). The display device 20A can communicate video and audio signals with an external device using the HDMI® receiving circuit 25 and the HDMI® transmitting circuit 26. The display device 20A also includes an optical mechanism 28 for projecting images. The optical mechanism 28 includes a light source such as a laser diode, LED, or lamp. The optical mechanism 28 also includes an optical unit that includes a liquid crystal element or a DMD (Digital Mirror Device) for modulating the light emitted from the light source, and a projection lens system for guiding the image light modulated by the light modulation element to the projection surface. Since the second display device 20B has the same configuration as the first display device 20A, its illustration is omitted.

[0024] <Photography equipment> The imaging device 30 captures the images projected by the display devices 20A and 20B. Preferably, the imaging device 30 is capable of capturing the entirety of a single image formed by combining multiple images used in the projection system 1. In the example shown in Figure 1A, the imaging device 30 captures an image that includes the image displayed on the screen by the first display device 20A and the image displayed on the screen by the second display device 20B.

[0025] As shown in Figure 1D, the imaging device 30 includes an arithmetic circuit 31, an input device 32, an output device 33, a communication circuit 34, a storage device 35, and an optical mechanism 36, etc. The arithmetic circuit 21, input device 22, output device 23, communication circuit 24, and storage device 27 are implemented by the same specific means as the arithmetic circuit 11, input device 12, output device 13, communication circuit 14, and storage device 15 described above using Figure 1B. The optical mechanism 36 includes a series of mechanisms related to the acquisition of image data and acquires image data according to control from the arithmetic circuit 31. Specifically, the optical mechanism 36 includes an image sensor, optical system elements, an A / D converter, etc.

[0026] <Processing in the adjustment device> Figure 2 shows a flowchart illustrating the overall adjustment process performed by the adjustment device 10 in this embodiment. The adjustment process may be initiated, for example, by operation via the input device 12.

[0027] When the adjustment process begins, the calculation circuit 11 controls each projection device 20A, 20B to project the pattern image 151 onto the screen (S1).

[0028] The calculation circuit 11 acquires the captured image (S2) from the imaging device 30, which is the pattern image projected in step S1.

[0029] When the arithmetic circuit 11 acquires the captured image in step S2, it performs processing for each of the projection devices 20A and 20B. In Figure 2, the processing related to the first projection device 20A is shown as steps S11 to S15. Also in Figure 2, the processing related to the second projection device 20B is shown as steps S21 to S25.

[0030] The calculation circuit 11 detects the projection areas of each projection device 20A and 20B from the captured image (S11). The projection area of ​​the image by the first projection device 20A is designated as the first area. The projection area of ​​the image by the second projection device 20B is designated as the second area.

[0031] Figure 6 shows an example of detecting the first projection region 501 projected by the first projection device 20A from a captured image 500 of arrangement state 1. The calculation circuit 11 can detect the projection region 501 of the first projection device 20A by, for example, detecting each vertex P11 to P14 of the first projection region 501 from the captured image 500. As described above in the explanation of the pattern image 151, the information (characters, colors, etc.) contained in the pattern image differs for each projection device 20A, 20. The calculation circuit 11 can detect the projection region of the target projection device from the differences in the information contained in the pattern image.

[0032] The calculation circuit 11 selects the arrangement of the projection areas for each projection device 20A and 20B from the captured image (S12). The first and second projection areas detected in step S11 are used to select the arrangement of the projection areas for each projection device 20A and 20B. The calculation circuit 11 selects the arrangement of the projection areas because the subsequent processing differs depending on the arrangement. The arrangement selection process will be described later with reference to Figure 3.

[0033] The arithmetic circuit 11 analyzes the projection area of ​​the image of the first projection device 20A in a manner determined by the arrangement selected in step S12 (S13). The analysis process of the first projection area will be described later with reference to Figures 5 and 8.

[0034] The arithmetic circuit 11 uses the analysis results from step S13 to generate a first adjustment signal used to adjust the first projection device 20A (S14). The adjustment signal generation process will be described later with reference to Figure 13.

[0035] The arithmetic circuit 11 transmits the first adjustment signal generated in step S14 to the first projection device 20A (S15). The first projection device 20A controls each parameter according to the first adjustment signal. This allows the adjustment device to adjust the first projection area.

[0036] The processes described in steps S11 to S15 above are an example of the processes performed by the arithmetic circuit 11 with respect to the adjustment of the first projection device 20A. The arithmetic circuit 11 performs the processes in steps S21 to S25 with respect to the adjustment of the second projection device 20B. The processes in steps S21 to S25 are the same as those in steps S11 to S15, so their explanation is omitted. The projection area of ​​the image by the second projection device 20B is referred to as the second projection area. The signal used for adjusting the second projection device 20B is referred to as the second adjustment signal.

[0037] In steps S11 and S21, the same projection area is detected. Therefore, the same result is obtained in steps S11 and S21. For this reason, the calculation circuit 11 does not need to perform the detection of the projection area in parallel. In that case, the calculation circuit 11 can use the result obtained in one process in subsequent processes related to each projection device 20A, 20B (S12, S13, S22, S23 in Figure 2).

[0038] If the projection area of ​​each projection device cannot be detected from the captured image in steps S11 and S12, the calculation circuit 11 outputs an error message to the output device 13 and terminates the series of processes. Also, even if the projection area is detected, if none of the arrangement states 1 to 3 are selected in steps S12 and S22, the calculation circuit 11 outputs an error message to the output device 13 and terminates the series of processes.

[0039] The calculation circuit 11 can distinguish between the first projection region and the second projection region from a single image acquired in step S2 and generate adjustment signals for the first projection device 20A and the second projection device 20B, respectively. Therefore, the projection system 1 according to this embodiment can be adjusted in a shorter time compared to the case where the projection regions of multiple projection devices 20A and 20B are detected from separate captured images and adjusted separately.

[0040] Furthermore, the arithmetic circuit 11 can execute the processes of steps S11 to S15 and steps S21 to S25 in parallel. This allows the arithmetic circuit 11 to transmit the first adjustment signal and the second adjustment signal simultaneously or nearly simultaneously. As a result, the arithmetic circuit 11 can complete the adjustment process for the first projection device 20A and the second projection device 20B nearly simultaneously. Therefore, the projection system 1 according to this embodiment can be executed in a shorter time compared to the case where the adjustment of the multiple projection devices 20A and 20B is performed separately.

[0041] 《Selection process for placement state》 The process of selecting the placement state will be explained using Figure 3. The process of selecting the placement state is performed in steps S12 and S22 of the flowchart in Figure 2.

[0042] Here, Figures 4A to 4C show examples of the arrangement of multiple projection regions 501 and 502 in the captured image 500, from arrangement state 1 to 3. The multiple projection regions 501 and 502 are the regions detected in steps S11 and S21. Figure 4A shows the arrangement of projection regions in arrangement state 1. In arrangement state 1, the multiple projection regions 501 and 502 are arranged in the captured image 500 without overlapping. Figure 4B shows the arrangement of projection regions in arrangement state 2. In arrangement state 2, the multiple projection regions 501 and 502 overlap, and the area ratio of the overlapping portion 510 is less than a predetermined ratio (for example, less than 80%) of the total area of ​​each projection region 501 and 502. Figure 4C shows the arrangement of projection regions in arrangement state 3. Arrangement state 3 is one in which multiple projection regions 501 and 502 overlap, and the area of ​​the overlapping portion 510 is equal to or greater than a predetermined percentage (for example, 80% or more) of the total area of ​​each projection region 501 and 502. In the example where the pattern image includes characters or marks, arrangement state 3 shown in Figure 4C is a case where the characters or marks overlap in the overlapping portion 510.

[0043] When the sorting state selection process begins, the arithmetic circuit 11 determines whether the sorting of projection regions in the captured image matches the conditions for sorting state 1 (S101). For example, if there are N projection devices and the projection regions are sorted without overlapping, the total number of vertices of the projection regions detected from the captured image will be N × 4. Therefore, the conditions for sorting state 1 specify that when there are N projection devices, the number of vertices of the projection regions included in the captured image is N × 4. Specifically, when images are projected from two projection devices 20A and 20B, the conditions for sorting state 1 are met when the number of vertices of the projection regions included in the captured image 500 is 8, as shown in Figure 4A.

[0044] When the conditions for arrangement state 1 are met (YES in S101), the arithmetic circuit 11 determines the current arrangement state of the projection region to arrangement state 1 (S102).

[0045] If the conditions for arrangement state 1 are not met (NO in S101), the arithmetic circuit 11 determines whether the arrangement state of the projection region meets the conditions for arrangement state 2 (S103).

[0046] When the conditions for arrangement state 2 are met (YES in S103), the arithmetic circuit 11 determines the current arrangement state of the projection region as the arrangement state (S104).

[0047] If the conditions for arrangement state 1 and arrangement state 2 are not met (NO in S103), the arithmetic circuit 11 determines that the arrangement state of the projection area is arrangement state 3 and terminates the arrangement state selection process (S105).

[0048] In step S22, the processes described in steps S101 to S105 are also executed for the second projection device 20B. Furthermore, steps S12 and S22 are performed on the same captured image. Therefore, the same results are obtained in steps S12 and S22. For this reason, the calculation circuit 11 does not need to execute the arrangement state selection process in parallel. In that case, the calculation circuit 11 can use the result obtained in one process in the subsequent analysis processes (S13 and S23 in Figure 2) for each projection device 20A and 20B.

[0049] 《Analysis Processing of Projected Area 1》 The projection region analysis process performed by the arithmetic circuit 11 will be explained using Figure 5. The projection region analysis process is performed in steps S13 and S23 of the flowchart in Figure 2. The projection region analysis process 1 shown in Figure 5 is performed when either arrangement state 1 or arrangement state 2 is selected in steps S12 and S22 of the flowchart in Figure 2. Below, the analysis process 1 of the first projection region 501, which is performed as step S13, will be explained as an example.

[0050] The arithmetic circuit 11 detects the size of the projection region from the projection region detected in step S11 (S201). The arithmetic circuit 11 also detects the position of the projection region detected in step S11 from the captured image obtained in step S2, and terminates the analysis process of the projection region (S202).

[0051] In step S23, the processes described in steps S201 to S202 are also executed, targeting the projection area of ​​the second projection device 20B.

[0052] For example, the arithmetic circuit 11 can handle the size and position of the projection region based on pixels in the captured image 500. Specifically, the arithmetic circuit 11 can determine the position of the projection region in the captured image by using the coordinates of the pixels at the vertices of the target projection region detected in the captured image. Furthermore, the arithmetic circuit 11 can determine the area of ​​the projection region by using the number of pixels contained in the rectangle formed by each vertex of the target projection region detected from the captured image. The arithmetic circuit 11 performs steps S13 and S23 using the same captured image 500. Therefore, the arithmetic circuit 11 can detect the size and position of each projection region 501, 502 using the same reference.

[0053] The above explanation described an example of detecting a projection region from a captured image 500 of arrangement state 1. In arrangement state 2, the method for detecting the projection region in step S201 is different from that in arrangement state 1. Therefore, using Figure 7, we will explain an example of detecting the first projection region 501 projected by the first projection device 20A from a captured image 500 of arrangement state 2. Even if the calculation circuit 11 extracts the contours of projection regions 501 and 502 from the captured image 500 of arrangement state 2, it can only detect the three vertices P31 to P33 of the first projection region 501. Specifically, the calculation circuit 11 cannot detect the vertex P34 included in the overlapping portion 510 from the contours of projection regions 501 and 502. Therefore, from the captured image 500 of arrangement state 2, each projection region 501 and 502 can be detected using, for example, the following methods 1 to 3.

[0054] (Method 1) For example, if each projection device 20A and 20B employs a pattern image of a different color, the overlapping portion 510 will be displayed with the components of the different colors superimposed. More specifically, suppose the pattern image projected by the first projection device 20A is a red image. Also, suppose the pattern image projected by the second projection device 20B is a blue image. In this case, the overlapping portion 510 will contain both the red and blue components. Therefore, the calculation circuit 11 can detect the first projection region 501 of the red component by removing the blue component from the captured image. Furthermore, the calculation circuit 11 can determine the coordinates of all vertices P31 to P34 from the first projection region 501 of the red component detected by removing the blue component.

[0055] (Method 2) On the other hand, if the color components of the pattern images used by each projection device 20A and 20B are the same, but the characters and other information included in the pattern images are treated as different information, then it is not possible to distinguish between the projection regions 501 and 502 based on the difference in color components. However, the overlapping portion 510 has a higher brightness compared to the non-overlapping portions of projection regions 501 and 502. Therefore, when projection regions 501 and 502 cannot be distinguished by color components, the calculation circuit 11 utilizes the difference in brightness. Specifically, the calculation circuit 11 can detect the region with high brightness as the overlapping portion 510. Furthermore, the calculation circuit 11 can determine the coordinates of the remaining vertices P34 of the first projection region 501 from the detected overlapping portion 510, according to the other vertices P31 to P33.

[0056] (Method 3) Furthermore, the arithmetic circuit 11 detects the coordinates of three vertices for each projection region 501, 502, and may calculate the coordinates of other vertices if possible. For example, as shown in Figure 7, when the coordinates of vertices P31 to P33 have been detected, the arithmetic circuit 11 can determine the vertical and horizontal pixel counts of the first projection region 501. Therefore, the arithmetic circuit 11 can use the calculated vertical and horizontal pixel counts to determine the coordinates of point P34. Alternatively, the arithmetic circuit 11 may use the overlapping portion 510 to determine the coordinates of point P34. Specifically, the arithmetic circuit 11 can determine the coordinates of point P34 from each vertex of the overlapping portion.

[0057] 《Analysis Processing of Projected Region 2》 Figure 8 shows a flowchart illustrating the analysis process 2 of the projection region, which is executed when arrangement state 3 is selected in steps S12 and S22 of the flowchart in Figure 2. When arrangement state 3 is selected, as shown in Figure 4C, it can be difficult to easily detect each projection region 501 and 502 from the captured image 500. Therefore, the calculation circuit 11 projects a masked pattern image in order to detect each projection region 501 and 502. Below, the analysis process 1 of the first projection region 501, which is executed as step S13, will be explained as an example.

[0058] First, the arithmetic circuit 11 generates a mask image that masks a portion of the pattern image 151 (S301). For example, the arithmetic circuit 11 generates a mask image that masks the right half of the pattern image 151 projected from the first projection device 20A.

[0059] Next, the arithmetic circuit 11 projects the pattern image masked with the mask image generated in step S301 onto the first projection device 20A (S302). Figure 9A shows the pattern image 151A masked with the mask image 600A. Figure 9B shows a hypothetical captured image 500 where only the masked pattern image 151A shown in Figure 9A is projected. In the example shown in Figure 9B, the first projection area 501 is smaller because the pattern image is masked.

[0060] When the pattern image masked using the mask image is projected by each projection device 20A, 20B, the calculation circuit 11 acquires the captured image from the imaging device 30 (S303).

[0061] The calculation circuit 11 detects the projection area of ​​the target from the captured image acquired in step S303 (S304).

[0062] The arithmetic circuit 11 detects the size and position of the projection region from the projection region detected in step S304, and terminates the analysis process of the projection region (S305).

[0063] Now, let's consider the process performed in step S23. For example, the arithmetic circuit 11 generates a mask image that masks the left half of the pattern image projected from the second projection device 20B. Figure 9C shows the pattern image 151B masked by the mask image 600B. Figure 9D shows a hypothetical captured image 500 in which only the masked pattern image 151B shown in Figure 9C is projected. In the example shown in Figure 9D, the second projection area 502 is smaller because the pattern image is masked.

[0064] Figure 10 shows an example of a captured image 500 in which the pattern image 151A shown in Figure 9A is projected from the first projection device 20A, and at the same time, the pattern image 151B shown in Figure 9B is projected from the second projection device 20B. By using the masked pattern images 151A and 151B, the captured image 500 acquired by the calculation circuit 11 in step S303 includes each projection region 501 and 502 without overlapping, as shown in Figure 10.

[0065] For example, in step S304, the arithmetic circuit 11 detects a rectangle with vertices P51, P53, P55, and P56 from the image acquired in step S303, as shown in Figure 11, to be the projection area of ​​the first projection device 20A.

[0066] Furthermore, in step S305, as shown in Figure 11, the arithmetic circuit 11 estimates the coordinates of points P52 and P54 based on the coordinates of P51, P53, P55, and P56 detected from the captured image 500, and detects the original projection area of ​​the first projection device 20A. The arithmetic circuit 11 can estimate the coordinates of points P52 and P54 using the shape and size of the mask image used in step S301.

[0067] In step S23, the processes described in steps S301 to S305 above are also executed for the second projection device 20B.

[0068] In the examples shown in Figures 9A and 9C, we have explained an example of a mask image that masks the left half or the right half of the pattern image 151 so that it does not overlap. However, the shape of the mask image is not limited as long as the projection areas of each projection device 20A and 20B can be distinguished so that they do not overlap. For example, the shape of the mask image can be determined by the number of projection devices included in the projection system 1 and the arrangement of the projection areas by each projection device. Figure 12A is an example of masking the lower part of the pattern image 151 with a mask image 600. Figure 12B is an example of masking the left two-thirds of the pattern image 151 with a mask image 600. Figure 12C is an example of masking the pattern image 151 with a mask image 600 so that only the upper left part is projected.

[0069] 《Generation process of adjustment signals》 Using Figure 13, the process of generating adjustment signals to adjust the projection of each projection device 20A and 20B will be explained. The process of generating adjustment signals is performed in steps S14 and S24 of the flowchart in Figure 2. Below, the process of generating adjustment signals to adjust the projection of the first projection device 20A, which is performed as step S14, will be explained as an example.

[0070] First, the arithmetic circuit 11 determines the size and position of the target projection area (S401). The size and position of the target projection area can be received, for example, via the input device 12. Alternatively, they may be pre-set and stored in the storage device 15. In Figure 14, the target projection area is shown by points P111 to P114.

[0071] The calculation circuit 11 compares the size and position of the target projection area of ​​the first projection device 20A determined in step S401 with the size and position of the current projection area of ​​the first projection device 20A detected in step S305 (S402). At this time, the overall shape of the actual projection area of ​​the first projection device 20A may be distorted, for example, depending on the positional relationship between the first projection device 20A and the screen. Therefore, the shape of the actual projection area of ​​the first projection device 20A will differ from the shape of the target projection area. In such a case, the first projection device 20A uses a portion of the actual projection area as the effective area. Here, the first projection device 20A sets the effective area to have the same aspect ratio as the shape of the target projection area. The first projection device 20A then uses the area within the effective area for projecting the image. The first projection device 20A does not use the area outside the effective area for projecting the image. Furthermore, the first projection device 20A adjusts the effective area to match the target projection area.

[0072] The arithmetic circuit 11 generates an adjustment signal (S403) using the comparison result from step S402. The adjustment signal is a signal that controls the projection area of ​​the first projection device 20A from its current state to the target state. Specifically, as shown in Figure 14, it is a control signal that changes the projection area of ​​the first projection device 20A from the current projection area identified by points P11 to P14 to the target projection area indicated by points P111 to P114. Specifically, the arithmetic circuit 11 calculates the size (height or width) of the effective area of ​​the first projection device 20A and compares it with the size of the target area. If the size of the effective area is larger than the size of the target area, the arithmetic circuit 11 sends a signal to reduce the zoom. On the other hand, if the size of the effective area is smaller than the size of the target area, the arithmetic circuit 11 sends a signal to increase the zoom. Repeating this process, the arithmetic circuit 11 makes the size of the effective area match the size of the target area. Next, the arithmetic circuit 11 compares a specific coordinate in the active area (for example, the coordinate of the top-left vertex) with the corresponding coordinate in the target area. If the specific coordinate in the active area is to the right of the corresponding coordinate in the target area, the arithmetic circuit 11 sends a signal to shift to the left. After the shift, the arithmetic circuit 11 compares the specific coordinate in the active area with the corresponding coordinate in the target area again. This process is repeated to move the active area up, down, left, and right until it matches the target area.

[0073] In step S24, the processes described in steps S401 to S403 are also executed for the second projection device 20B.

[0074] The projection system 1 according to this disclosure can perform adjustments on multiple projection devices simultaneously. Therefore, the projection system 1 according to this embodiment can be performed in a shorter time compared to the case where the adjustments on multiple projection devices are performed separately.

[0075] <Variation 1> In the example described above, the differences in information between each projection region 501 and 502 are used to detect each projection region 501 and 502 from the captured image 500. The adjustment device according to Modification 1 can detect each projection region 501 and 502 by masking the captured image 500 with a rectangular mask image determined according to the projection regions 501 and 502 to be detected. Although the adjustment device according to Modification 1 differs in that it masks the captured image 500, its other configurations are the same as the adjustment device 10 described above using Figures 1 and 2, and will be described above using Figures 1 and 2.

[0076] As shown in Figure 15A, suppose there is a captured image 500 that includes a first projection region 501 and a second projection region 502 that do not overlap. In this case, the calculation circuit 11 may generate a rectangular mask image 602 as shown in Figure 15B. The mask image 601 shown in Figure 15B can mask the second projection region 502, making only the first projection region 501 detectable. Therefore, the calculation circuit 11 can detect the first projection region 501 by using the mask image shown in Figure 15B in the analysis process of the first projection region in step S13. Alternatively, the calculation circuit 11 may generate a rectangular mask image 602 as shown in Figure 15B. The mask image 602 shown in Figure 15C can mask the first projection region 501, making only the second projection region 502 detectable. Therefore, the calculation circuit 11 can detect the second projection region 502 by using the mask image shown in Figure 15C in the analysis process of the second projection region in step S23.

[0077] In this way, the adjustment device 10 according to Modification 1 masks the captured image 500 with a rectangular mask image generated for each projection device 20A and 20B. As a result, the projection device 10 according to Modification 1 can detect the projection areas 501 and 502 and adjust the projection areas.

[0078] <Variation 2> In the modified example 1 described above, a rectangular mask image was used for masking. As shown in Figure 16A, suppose there is a captured image 500 that includes a first projection region 501 and a second projection region 502 with an overlapping portion 510. When there is an overlapping portion 510, it is difficult to accurately detect each projection region 501 and 502 with a rectangular mask image. The adjustment device 10 according to modified example 2 generates a mask image that fits the captured image 500 with the overlapping portion 510.

[0079] The calculation circuit 11 of the adjustment device 10 according to the modified example 2 may generate a mask image 601 as shown in Figure 16B. In Figure 16B, the hatched area is the area that is not masked. The mask image 601 shown in Figure 16B masks the second projection area 502, making it possible to detect the area projected only by the first projection area 501. Therefore, by using the mask image shown in Figure 16B in the analysis process of the first projection area in step S13, the calculation circuit 11 can detect the area of ​​the first projection area 501 excluding the overlapping portion 510.

[0080] The arithmetic circuit 11 may generate a mask image 602 as shown in Figure 16C. In Figure 15C, the hatched area is the area that is not masked. The mask image 602 shown in Figure 16C masks the first projection area 501, making it possible to detect the area projected only by the second projection area 502. Therefore, by using the mask image shown in Figure 16C in the analysis process of the second projection area in step S23, the arithmetic circuit 11 can detect the area of ​​the second projection area 502 excluding the overlapping portion 510.

[0081] In this way, the adjustment device 10 according to Modified Example 2 masks the captured image 500 with a mask image generated that includes the overlapping portion 510 generated for each projection device 20A and 20B. As a result, the projection device 10 according to Modified Example 2 can detect the projection regions 501 and 502 excluding the overlapping portion 510 and adjust the projection region.

[0082] Summary of the Embodiment (1) The adjustment method of this disclosure is an adjustment method for adjusting the projection area of ​​each projection device using a control device in a projection system that projects images from multiple projection devices, The control device is connected to each of the projection devices and to the imaging device. The control device includes an arithmetic circuit, The aforementioned arithmetic circuit, Each of the aforementioned projection devices is made to project a predetermined pattern image. A captured image showing the state in which multiple pattern images are projected is acquired from the imaging device. The regions of the pattern images projected by each projection device included in the captured image are detected and defined as the current projection regions of each projection device. A control signal is generated to change the projection area of ​​each projection device so that it is projected from the current projection area to a target projection area defined for each projection device. The generated control signals are transmitted to each of the projection devices.

[0083] This allows the projection area of ​​multiple projection devices to be adjusted using a single captured image. Therefore, adjustment time can be reduced compared to adjusting each projection device using separate captured areas.

[0084] (2) In the adjustment method of (1), The projection system includes a first projection device and a second projection device. The aforementioned arithmetic circuit, A first mask image is generated that covers the area other than the first pattern image projected by the first projection device. A second mask image is generated that covers the area other than the second pattern image projected by the second projection device. The captured image is masked with the first mask image to detect the first projection area of ​​the first projection device. The captured image may be masked with the second mask image to detect the second projection area of ​​the second projection device.

[0085] By masking the captured image, each projection area can be detected and adjusted to the desired state.

[0086] (3) In the adjustment method of (1), The projection system includes a first projection device and a second projection device. The aforementioned arithmetic circuit, The first projection device is made to project a first pattern image, in which a portion of the pattern image of the first projection device is masked by a first mask image. The second projection device is made to project a second pattern image, which is a part of the pattern image of the second projection device, that is not the first pattern image projected by the first projection device, with the second pattern image masked by the second mask image. From the projection region of the masked first pattern image, the first projection region is detected. The second projection region may be detected from the projection region of the masked second pattern image.

[0087] By masking the projection pattern image, even if the initial state has a complex projection area, each projection area can be detected and adjusted to the desired state.

[0088] (4) In the adjustment method of (1) to (3), the calculation circuit is used, Each of the aforementioned projection devices may simultaneously project a corresponding pattern image.

[0089] By masking the captured image, each projection area can be detected and adjusted to the desired state.

[0090] (5) In the adjustment methods of (1) to (4), Each of the pattern images projected from each of the projection devices may contain different information.

[0091] Each pattern image contains different information, allowing each projection region to be detected from a single captured image.

[0092] (6) In the adjustment methods of (1) to (5), The aforementioned pattern image may include coordinate information indicating at least three predetermined points.

[0093] Each pattern image includes coordinate information indicating three predetermined points, allowing the projection area by the projection device to be detected.

[0094] (7) The adjustment device of the present disclosure is an adjustment device for adjusting the projection area of ​​each projection device in a projection system that projects images from a plurality of projection devices, The adjustment device includes a calculation circuit and is connected to each of the projection devices and the imaging device. The aforementioned arithmetic circuit is Each of the aforementioned projection devices is made to project a predetermined pattern image. A captured image showing the state in which multiple pattern images are projected is acquired from the imaging device. The regions of the pattern images projected by each projection device included in the captured image are detected and defined as the current projection regions of each projection device. A control signal is generated to change the projection area of ​​each projection device so that it is projected from the current projection area to a target projection area defined for each projection device. The generated control signals may be transmitted to each of the projection devices.

[0095] This allows the projection area of ​​multiple projection devices to be adjusted using a single captured image. Therefore, adjustment time can be reduced compared to adjusting each projection device using separate captured areas.

[0096] (8) The computer program of this disclosure may cause the adjustment device to execute the adjustment method described in any one of (1) to (6).

[0097] This allows the projection area of ​​multiple projection devices to be adjusted using a single captured image. Therefore, adjustment time can be reduced compared to adjusting each projection device using separate captured areas.

[0098] The adjustment methods, adjustment devices, and computer programs described in all claims of this disclosure are implemented by hardware resources, such as a processor, memory, and cooperation with computer programs. [Industrial applicability]

[0099] The adjustment method, adjustment apparatus, and computer program of this disclosure are useful for adjusting the projection area of ​​each projection device in a projection system that projects images using multiple projection devices. [Explanation of symbols]

[0100] 1. Projection System 10 Adjustment device 11 Arithmetic circuit 12 Input devices 13 Output device 14. Communication Circuit 15 Storage device 151 Pattern Images P Adjustment Program 20A,20B Projection device 30 Imaging device

Claims

1. A projection system that projects images from multiple projection devices, comprising an adjustment method for adjusting the projection area of ​​each projection device using a control device, The control device is connected to each of the projection devices and to the imaging device. The control device includes an arithmetic circuit, The aforementioned arithmetic circuit, Each of the aforementioned projection devices is made to project a predetermined pattern image. A captured image showing the state in which multiple pattern images are projected is acquired from the imaging device. The regions of the pattern images projected by each projection device included in the captured image are detected and defined as the current projection regions of each projection device. A control signal is generated to change the projection area of ​​each projection device so that it is projected from the current projection area to a target projection area defined for each projection device. The generated control signals are transmitted to each of the projection devices. Adjustment method.

2. The projection system includes a first projection device and a second projection device. The aforementioned arithmetic circuit, A first mask image is generated that covers the area other than the first pattern image projected by the first projection device. A second mask image is generated that covers the area other than the second pattern image projected by the second projection device. The captured image is masked with the first mask image to detect the first projection area of ​​the first projection device. The captured image is masked with the second mask image to detect the second projection region of the second projection device. The adjustment method according to claim 1.

3. The projection system includes a first projection device and a second projection device. The aforementioned arithmetic circuit, The first projection device is made to project a first pattern image, in which a portion of the pattern image of the first projection device is masked by a first mask image. The second projection device is made to project a second pattern image, which is a part of the pattern image of the second projection device, that is not the first pattern image projected by the first projection device, with the second pattern image masked by the second mask image. From the projection region of the masked first pattern image, the first projection region is detected. The second projection region is detected from the projection region of the masked second pattern image. The adjustment method according to claim 1.

4. The aforementioned arithmetic circuit, Each of the aforementioned projection devices simultaneously projects a corresponding pattern image. The adjustment method according to claim 1.

5. Each of the pattern images projected from each of the aforementioned projection devices is an image containing different information. The adjustment method according to claim 1.

6. The aforementioned pattern image includes coordinate information indicating at least three predetermined points. The adjustment method according to claim 1.

7. In a projection system that projects images from multiple projection devices, an adjustment device is provided to adjust the projection area of ​​each projection device, The adjustment device includes a calculation circuit and is connected to each of the projection devices and the imaging device. The aforementioned arithmetic circuit is Each of the aforementioned projection devices is made to project a predetermined pattern image. A captured image showing the state in which multiple pattern images are projected is acquired from the imaging device. The regions of the pattern images projected by each projection device included in the captured image are detected and defined as the current projection regions of each projection device. A control signal is generated to change the projection area of ​​each projection device so that it is projected from the current projection area to a target projection area defined for each projection device. The generated control signals are transmitted to each of the projection devices. Adjustment device.

8. A computer program that causes an adjustment device to perform the adjustment method described in any one of claims 1 to 6.

Images