Image projection system, control method for image projection system, and program
The image projection system addresses the challenge of selecting projectors by projecting identification and area information, capturing these with an imaging unit, and superimposing area images on the display, enabling intuitive and accurate projector selection.
Patent Information
- Application Number
- JP2023155623
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-09-21
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2040-03-25
AI Technical Summary
Conventional image projection systems face difficulties in intuitively selecting the appropriate projector due to the lack of direct visual feedback on the positional relationship between projected images and the actual projection target, especially in multi-projection scenarios or when image boundaries are unclear.
An image projection system that includes multiple projectors projecting identification information and area information onto a target, an imaging unit capturing these images, and a control unit generating and superimposing area images on the captured images to facilitate intuitive projector selection on a display terminal.
Enhances operability by allowing for intuitive selection of projectors based on clear visual feedback of projected image areas and their relationships, improving adjustment accuracy and efficiency.
Smart Images

Figure 0007588330000001 
Figure 0007588330000002 
Figure 0007588330000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an image projection system, a control method for an image projection system, and a program. [Background technology]
[0002] Conventionally, there is known an image projection system that projects images arranged on a projection surface by a plurality of projectors. For example, Patent Document 1 discloses an image projection system that associates each projector with a projection image on a projection surface. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-116689 A Summary of the Invention [Problem to be solved by the invention]
[0004] In a conventional image projection system, a frame image indicating the area of the projected image on the projection surface may be displayed on a display terminal, and the frame image for the projector to be operated may be selected on the display terminal to adjust that projector.
[0005] However, since only the frame image is checked on the display terminal to select the projector to be operated, it is not possible to check on the display terminal the positional relationship between the actual projection target, such as a screen or building, and the projected image, which can make it difficult to intuitively select a projector.
[0006] For example, in the case of multi-projection with a large number of units, or when the boundaries of the projected images are not clear due to blending processing, etc., it can become even more difficult to select the projector to be operated by viewing only the frame image on the display terminal.
[0007] Therefore, an object of the present disclosure is to solve the above-mentioned problems and to provide an image projection system, a control method for an image projection system, and a program that enable intuitive selection of the projector to be operated and improve operability. [Means for solving the problem]
[0008] In one embodiment of the present disclosure, an image projection system includes: of The present invention relates to a method for projecting a projection image including area information of a projection area onto a projection target, the method comprising: projecting a projection image including area information of a projection target onto a projection target by arranging projection images on the projection target; R A control unit that generates an area image indicating an area of a projection image based on the area information, and a control unit that superimposes the area image on an image of the projection target captured by the image capturing unit. hand and a display terminal for displaying the R .
[0009] A control method for an image projection system according to one aspect of the present disclosure is a control method for an image projection system including a plurality of projectors, an imaging unit that captures projected images of the projectors, a display terminal that displays information related to the projected images, and a control unit that controls the projectors, the control method including the control step including a projection step of projecting projection images including area information of the projection areas of the respective projectors side by side onto a projection target, an imaging step of imaging the projection target and each of the projection images projected onto the projection target by the plurality of projectors, using the imaging unit; P A region image generating step of generating a region image showing a region of a projection image of the projector by a control unit based on region information; and a step of superimposing the region image on a captured image of a projection target captured by an imaging unit. hand Including a display step for displaying on a display terminal nothing .
[0010] The program according to one embodiment of the present disclosure of A program executed by a control unit to control a plurality of projectors that each arranges projection images, each including area information of a projection area, and projects the images onto a projection target, the program comprising: P A region image generating step of generating a region image showing a region of a projection image of the projector based on region information; and a step of superimposing the region image on a captured image of the projection target captured by an imaging section. hand Including a display step for displaying on a display terminal nothing . Effect of the Invention
[0011] According to the image projection system, the control method for the image projection system, and the program of the present disclosure, the projector to be operated can be intuitively selected, thereby improving operability. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is a schematic configuration diagram of an image projection system according to a first embodiment of the present disclosure. [Diagram 2] FIG. 1 is a block diagram showing a schematic configuration of an image projection system according to a first embodiment of the present disclosure. [Diagram 3] FIG. 1 is a schematic diagram showing a flow of a control method for an image projection system according to a first embodiment of the present disclosure. [Figure 4] FIG. 1 is a schematic diagram showing the display content of a display unit of an operation terminal according to a first embodiment of the present disclosure. [Diagram 5] FIG. 11 is a block diagram showing a schematic configuration of an image projection system according to a second embodiment of the present disclosure. [Figure 6] FIG. 13 is a schematic diagram showing a state in which a two-dimensional code of identification information is projected onto a projection target according to a second embodiment of the present disclosure. [Figure 7] FIG. 11 is a schematic diagram showing a flow of an image correction method according to a second embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] The image projection system of the first aspect of the present disclosure includes a plurality of projectors that each arranges projection images, each including identification information of the projector and area information of the projection area, and projects them onto a projection object; an imaging unit that captures the projection object and each of the projection images projected onto the projection object by the plurality of projectors; a control unit that associates the projection images with the projectors that project the projection images based on the identification information included in the projection images captured by the imaging unit and generates an area image showing the area of the projection image based on the area information; and a display terminal that displays the area image selectably by superimposing it on the captured image of the projection object captured by the imaging unit, and makes it possible to adjust the projector corresponding to the area image selected on the display terminal.
[0014] With this system, the positional relationship between the area image and the captured image of the projection target can be confirmed on the display terminal by superimposing the area image on the captured image of the projection target with the area image. This allows intuitive selection of the area image corresponding to the projection image to be adjusted, improving operability.
[0015] In the image projection system according to the second aspect of the present disclosure, the identification information may include a marker projected onto the projection target by the projector.
[0016] Such a system makes it possible to calculate the area of the projected image from the markers, and generate a more accurate area image of the area.
[0017] In the image projection system according to the third aspect of the present disclosure, the control unit may generate a regional image based on the shape of the marker projected onto the projection object.
[0018] With such a system, even if the area of the projected image is deformed due to the relative positions of the projector and the projection object, the area of the projected image can be calculated from the shape of the marker, and a more accurate area image of the area can be generated.
[0019] In the image projection system of the fourth aspect of the present disclosure, the marker may include a two-dimensional code.
[0020] Such a system allows the projection image to be associated with the projector by a two-dimensional code, and allows the area of the projection image to be calculated.
[0021] In the image projection system according to the fifth embodiment of the present disclosure, the identification information may include a light ID that identifies the projector by modulating the light of the projector.
[0022] With such a system, a light ID can be used to include identification information in a projected image in a manner that is not visually discernible.
[0023] In the image projection system according to the sixth aspect of the present disclosure, the control unit may acquire position information of the display terminal, and correct the area image displayed on the display terminal based on the position information.
[0024] With such a system, by correcting the area image based on position information, even if the display terminal is moved, the area image can be displayed on the display terminal without having to re-associate the projected image with the projector based on the identification information.
[0025] In the image projection system of the seventh aspect of the present disclosure, the captured image of the projection object displayed on the display terminal is an image captured in real time by an imaging unit, and the display terminal may display an area image by superimposing it on the image.
[0026] With such a system, by displaying the image captured by the imaging unit in real time on the display terminal, it is possible to more intuitively select the area image corresponding to the projection image to be adjusted.
[0027] A control method for an image projection system according to an eighth aspect of the present disclosure is a control method for an image projection system including a plurality of projectors, an imaging unit that captures projection images of the projectors, a display terminal that displays information related to the projection images, and a control unit that controls the projectors, and includes a projection step in which the plurality of projectors project projection images, each including their own identification information and area information of the projection area, side by side onto a projection object, respectively; an imaging step in which the imaging unit captures the projection object and each of the projection images projected onto the projection object by the plurality of projectors; an association step in which the control unit associates the projection images with the projectors that project the projection images based on the identification information included in the projection images captured by the imaging step; an area image generation step in which the control unit generates an area image indicating the area of the projection image of the projector associated by the association step based on the area information; and a display step in which the area image is superimposed on the image of the projection object captured by the imaging unit and displayed on the display terminal in a selectable manner, thereby making it possible to adjust the projector corresponding to the area image selected on the display terminal.
[0028] With this method, the area image is superimposed on the captured image of the projection target and displayed on the display terminal, so that the positional relationship between the area image and the captured image of the projection target can be confirmed on the display terminal. This allows intuitive selection of the area image corresponding to the projection image to be adjusted, improving operability.
[0029] A program of a ninth aspect of the present disclosure is a program executed by a control unit that controls a plurality of projectors that line up and project projection images, each including identification information of the projector itself and area information of the projection area, onto a projection target, and includes an association step of associating the projection image with the projector that projects the projection image based on the identification information included in the projection image captured by the imaging unit, an area image generation step of generating, based on the area information, an area image indicating the area of the projection image of the projector associated by the association step, and a display step of superimposing the area image on the captured image of the projection target captured by the imaging unit and displaying it on a display terminal so that it can be selected, thereby making it possible to adjust the projector corresponding to the area image selected on the display terminal.
[0030] With such a program, the area image is superimposed on the captured image of the projection target and displayed on the display terminal, so that the positional relationship between the area image and the captured image of the projection target can be confirmed on the display terminal. This allows intuitive selection of the area image corresponding to the projection image to be adjusted, improving operability.
[0031] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the present disclosure is not limited to these embodiments.
[0032] (Embodiment 1) First, a schematic configuration of an image projection system 1 according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing a schematic configuration of the image projection system 1.
[0033] 1, the image projection system 1 includes a plurality of projectors 10 that project a projection image 5 onto a projection target 3, and an operation terminal 30 for operating the projectors 10. Each projector 10 is connected to the operation terminal 30 via, for example, a wireless network.
[0034] The projection target 3 is an object onto which the projection image 5 can be projected by the projector 10. For example, the projection target 3 is a building, a screen, or the like.
[0035] In the image projection system 1, the multiple projectors 10 each project a projection image 5 onto the projection object 3. In FIG. 1, the outer edge of each projection image 5 is indicated by a thick line. The projection images 5 of the projector 10 of this embodiment are projected by the projector 10 so as to be arranged side by side on the projection object 3. For example, the projection images 5 are arranged side by side in multiple directions (vertical and horizontal) on the projection object 3. This allows the projection images 5 to be projected over a wide range on the projection object 3.
[0036] The projection images 5 projected from the multiple projectors 10 are projected on the projection target 3 such that adjacent projection images 5 partially overlap each other. This allows the projection images 5 to be displayed integrally without forming blank areas between the projection images 5 where no projection image 5 is projected. In addition, in the overlapping areas of adjacent projection images 5, a blending process, for example, is performed to adjust the brightness to make the seams between the images less noticeable. Note that some of the multiple projection images 5 may not have overlapping parts, or all of the multiple projection images 5 may not have overlapping parts.
[0037] The projected image 5 includes identification information 7 of the projector 10. The identification information 7 is information that can identify the correspondence between the projected image 5 and the projector 10. The identification information 7 in this embodiment is a marker projected by the projector 10 onto the projection target 3. The marker is, for example, a two-dimensional code such as a QR code (registered trademark).
[0038] The identification information 7 (two-dimensional code) of the present embodiment includes area information of the projection area of the projector 10. Here, the area information is information indicating the positions of at least three points displayed in the projected image 5, and is information associated with the projection area of the projector 10. The projection area of the projector 10 is calculated based on the area information.
[0039] The operation terminal 30 of this embodiment includes an imaging unit 31 (FIG. 2), a display unit (display terminal) 32, and a control unit 33 (FIG. 2). For example, the operation terminal 30 is an information processing device such as a tablet terminal, a smartphone, or a personal computer (PC).
[0040] The imaging unit 31 is, for example, a camera mounted on the operation terminal 30. The imaging unit 31 captures the projection target 3 and the projection image 5. The imaging unit 31 captures the identification information 7 displayed on the projection image 5.
[0041] The display unit 32 is, for example, a display of the operation terminal 30. The display unit 32 displays information captured by the imaging unit 31. Specifically, the display unit 32 displays an image (captured image) of the projection target 3 captured by the imaging unit 31. Furthermore, the display unit 32 displays a frame image 52 ( FIG. 4 ) indicating the area of the projection image 5 captured by the imaging unit 31, superimposed on the image (captured image) of the projection target 3. For example, pixels of the portion of the captured image to be superimposed and displayed are pixels based on the information of the frame image 52.
[0042] The image (captured image) of the projection target 3 displayed on the display unit 32 may be an image captured in real time by the imaging unit 31, and the image may be displayed with the frame image 52 superimposed on it. This allows the frame image 52 corresponding to the projection image 5 to be adjusted to be selected more intuitively.
[0043] The control unit 33 controls the projector 10 corresponding to the frame image 54 (FIG. 4) selected on the display unit 32. The control unit 33 includes, for example, a memory and a processing circuit corresponding to a processor such as a CPU. The control unit 33 adjusts the projector 10 by causing the processor to execute a program stored in the memory.
[0044] Next, a more specific configuration of the image projection system 1 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing a schematic configuration of the image projection system 1.
[0045] As shown in FIG. 2, the control unit 33 of the operation terminal 30 includes an information analysis unit 34, an association unit 35, a frame image generation unit 36, and a projector control unit 37.
[0046] The information analysis unit 34 analyzes the two-dimensional code of the identification information 7 included in the projection image 5 captured by the imaging unit 31. The information analysis unit 34 analyzes the two-dimensional code of the identification information 7 to identify which projector 10 is projecting the projection image 5 from.
[0047] The information analysis unit 34 of this embodiment calculates the area of the projected image 5 of the projection target 3 from the size of the two-dimensional code of the identification information 7. For example, a relationship between the area of the projected image 5 and the size of the two-dimensional code is stored in advance in a storage unit (not shown) of the control unit 33, and the information analysis unit 34 calculates the area of the projected image 5 based on this relationship.
[0048] In the present embodiment, the information analysis unit 34 further uses the shape of the two-dimensional code projected onto the projection object 3 in calculating the area of the projected image 5 on the projection object 3. The information analysis unit 34 identifies whether the two-dimensional code is projected onto the projection object 3 in a distorted shape such as a rectangle or trapezoid rather than a square shape. If the two-dimensional code is distorted, the information analysis unit 34 corrects the area of the projected image 5 according to the shape of the two-dimensional code.
[0049] For example, there is a similar relationship between the area shape of the projected image 5 and the shape of the two-dimensional code projected onto the projection target 3. The information analysis unit 34 corrects the area of the projected image 5 based on, for example, the deformation ratio from a square shape (the vertical deformation ratio and the horizontal deformation ratio).
[0050] The associating unit 35 associates the projected image 5 with the projector 10 that projects the projected image 5 based on the analysis result by the information analyzing unit 34. This makes it possible to grasp the correspondence between a plurality of projected images 5 and a plurality of projectors 10.
[0051] The frame image generating unit 36 generates a frame image 52 indicating the area of the projected image 5. Specifically, the frame image generating unit 36 generates an image (frame image 52) to be displayed on the display unit 32, which corresponds to the area of the projected image 5 analyzed by the information analyzing unit 34. An outer frame is displayed in the frame image 52 so that the area of the frame image 52 is clear.
[0052] The projector control unit 37 controls the projector 10 to adjust the projected image 5 projected by the projector 10. For example, the projector control unit 37 transmits commands to the projector 10 to adjust the brightness, contrast, color matching, blending, distortion, and the like of the projected image 5.
[0053] The projector 10 includes a projection unit 11, a command receiving unit 12, and an image processing unit 13.
[0054] The projection unit 11 projects a projection image 5 onto a projection target 3. The command receiving unit 12 receives a command from a projector control unit 37 of the operation terminal 30. Furthermore, the command receiving unit 12 transmits the received command to the image processing unit 13.
[0055] The image processing unit 13 processes the image to be projected onto the projection target 3, based on the command received by the command receiving unit 12. The image processing unit 13 has an input unit 14, a correction unit 15, and an output unit 16.
[0056] The input unit 14 acquires image data from an image supply device (not shown). The image supply device is a device that supplies image data to the projector 10. The image supply device is, for example, an information processing device such as a tablet terminal, a smartphone, or a personal computer (PC). The image supply device is connected to the input unit 14 via, for example, a cable or a wireless network.
[0057] The correction unit 15 corrects the image data acquired by the input unit 14 based on the command received by the command receiving unit 12. The output unit 16 outputs the image data corrected by the correction unit 15 to the projection unit 11. The corrected image data output by the output unit 16 is projected by the projection unit 11 onto the projection target 3, and the projection image 5 is displayed on the projection target 3.
[0058] Next, a method for controlling the image projection system 1 will be described with reference to Fig. 3. Fig. 3 is a schematic diagram showing the flow of the method for controlling the image projection system 1.
[0059] 3, the control method of the image projection system 1 includes a projection step ST10, an imaging step ST20, an information analysis step ST30, an association step ST40, and a frame image generation step ST50. Furthermore, the control method of the image projection system 1 includes a display step ST60, a selection step ST70, and an adjustment step ST80.
[0060] In a projection step ST10, a plurality of projectors 10 project projection images 5 including their own identification information 7 side by side onto the projection target 3. Each projector 10 (projection unit 11) projects image data output by an output unit 16 onto the projection target 3. As a result, the projection images 5 are displayed on the projection target 3 side by side. In the projection step ST10, when the projection images 5 and the projectors 10 are associated with each other, a two-dimensional code of the identification information 7 is temporarily projected, and after the association is completed, the two-dimensional code is hidden in the projection images 5.
[0061] In the imaging step ST20, the projection target 3 and the projection image 5 projected onto the projection target 3 are imaged by the imaging section 31. In the imaging step ST20, the identification information 7 of the projection image 5 is imaged by the imaging section 31.
[0062] In an information analysis step ST30, the identification information 7 captured by the imaging section 31 is analyzed by the information analysis section . The analyzed information by the information analysis section is transmitted to the association section .
[0063] In an associating step ST40, the associating section 35 associates the projected image 5 with the projector 10 that projects the projected image 5 based on the analysis information by the information analysis section 34.
[0064] In the frame image generating step ST50, the frame image generating section 36 generates a frame image 52 indicating the area of the projected image 5 of the projector 10 associated in the associating step ST40.
[0065] The imaging step ST20, the information analysis step ST30, the association step ST40, and the frame image generation step ST50 are performed in order for each of the multiple projectors 10. As a result, a frame image 52 for each projector 10 is generated.
[0066] In a display step ST60, frame images 52 relating to each projector 10 are superimposed on an image (captured image) of the projection target 3 captured by the imaging unit 31 and displayed on the display unit 32. When adjacent projection images 5 are projected on the projection target 3 in a state where they partially overlap each other, the corresponding frame images 52 are also displayed in a state where they partially overlap each other.
[0067] In a selection step ST70, the frame image 52 corresponding to the projector 10 to be operated is selected on the display unit 32.
[0068] In an adjustment step ST80, the projector 10 corresponding to the selected frame image 54 is controlled. As a result, the projection image 5 projected by the projector 10 is adjusted.
[0069] Next, an example of the display content of the display unit 32 will be described with reference to Fig. 4. Fig. 4 is a schematic diagram showing the display content of the display unit 32.
[0070] As shown in FIG. 4, the display unit 32 has a first display section 41, a second display section 42, a third display section 43, and a fourth display section 44.
[0071] An image of the projection target object 3 captured by the imaging unit 31 (captured image 50) and a frame image 52 are displayed on the first display unit 41. The frame image 52 is displayed superimposed on the captured image 50 on the first display unit 41. When adjusting the projector 10, a frame image 52 corresponding to the projection image 5 projected by the projector 10 to be adjusted is selected from the multiple frame images 52. The selected frame image 54 is highlighted, for example, with lines thicker than those of the other frame images 52.
[0072] The second display section 42 displays information about the projector 10 corresponding to the selected frame image 54. The second display section 42 displays, for example, the identification number of the projector 10.
[0073] Adjustment items for the projector 10 to be operated are displayed on the third display section 43. For example, adjustment items related to the brightness, contrast, color matching, blending, distortion correction, etc. of the projected image 5 are displayed on the third display section 43.
[0074] The fourth display unit 44 displays setting information of the image to be displayed on the first display unit 41. The fourth display unit 44 displays setting information such as the display mode of the first display unit 41 and the content to be displayed on the first display unit 41. The display mode includes, for example, a normal mode in which a past image captured by the imaging unit 31 is displayed as the captured image 50, and an AR mode in which a video captured in real time by the imaging unit 31 is displayed as the captured image 50.
[0075] The present disclosure is not limited to the above-described embodiment, and can be implemented in various other modes. For example, the identification information 7 is not limited to a two-dimensional code, as long as it is information that can identify the correspondence between the projected image 5 and the projector 10. The identification information 7 may include, for example, a light ID that identifies the projector 10 by modulating the light of the projector 10. The light ID is an ID corresponding to each projector 10. The light ID is a visible light communication technology that transmits information using the blinking of the light of the projector 10, and is generated based on the ON / OFF control of the light projected from the projector 10.
[0076] When identifying the correspondence between the projected image 5 and the projector 10 by the light ID, a marker may be projected onto the projected image 5 in order to calculate the area of the projected image 5. The marker may be temporarily displayed, for example, over the entire area of the projected image 5. The shape of the marker may be any shape, such as a polygonal shape, a circular shape, an elliptical shape, or the like.
[0077] In addition, the operation terminal 30 includes the imaging unit 31, the display unit (display terminal) 32, and the control unit 33, but is not limited to this. For example, the imaging unit 31, the display unit 32, and the control unit 33 may each be an independent device.
[0078] Furthermore, the frame image 52 may be any area image that is displayed so as to be distinguishable from other images, and may be, for example, an image without an outer frame.
[0079] Also, the imaging step ST20, the information analysis step ST30, the association step ST40, and the frame image generation step ST50 are performed in sequence for each of the multiple projectors 10, but are not limited to this. The imaging step ST20, the information analysis step ST30, the association step ST40, and the frame image generation step ST50 may be performed simultaneously for the multiple projectors 10. This allows the frame image 52 to be generated more efficiently.
[0080] Furthermore, although the identification information 7 includes area information on the projection area of the projector 10, the projected image 5 may include area information in addition to the identification information 7.
[0081] (Embodiment 2) Next, the image projection system 1A of the second embodiment will be described, mainly focusing on the differences from the first embodiment. In the second embodiment, the same or equivalent configurations as those of the first embodiment will be denoted by the same reference numerals. Furthermore, in the second embodiment, descriptions that overlap with those of the first embodiment will be omitted as appropriate.
[0082] Fig. 5 is a block diagram showing a schematic configuration of the image projection system 1A. Fig. 6 is a schematic diagram showing a state in which a two-dimensional code of the identification information 7 is projected onto the projection target 3. In the image projection system 1A, the image displayed on the display unit 32 is corrected based on the position information of the operation terminal 30A. Specifically, the image displayed on the display unit 32 is corrected by performing a coordinate conversion from the coordinates of the two-dimensional code of the identification information 7 based on the point P1 before the movement to the coordinates of the two-dimensional code of the identification information 7 based on the point P2 after the movement.
[0083] As shown in FIG. 5, the control unit 33A further includes a coordinate acquisition unit 60, a position information acquisition unit 62, a coordinate conversion unit 64, and an image correction unit 66.
[0084] The coordinate acquisition unit 60 acquires the coordinates of the two-dimensional code of the identification information 7 based on point P1 (FIG. 6) of the operation terminal 30A before movement. For example, the coordinate acquisition unit 60 acquires the coordinates of the four corners Q1 to Q4 of the two-dimensional code of the identification information 7 based on point P1. The coordinate acquisition unit 60 acquires the coordinates of the four corners Q1 to Q4 by, for example, a distance sensor. The acquired coordinates of the four corners Q1 to Q4 are stored in a storage unit (not shown).
[0085] The position information acquisition unit 62 acquires position information of the operation terminal 30A by, for example, a satellite positioning system such as GPS. The position information acquired by the position information acquisition unit 62 is stored in the storage unit. The position information acquisition unit 62 acquires position information (first position information) of the operation terminal 30A at point P1 before the movement and position information (second position information) of the operation terminal 30A at point P2 after the movement.
[0086] The coordinate conversion unit 64 calculates the coordinates of the four corners Q1 to Q4 of the two-dimensional code of the identification information 7 based on the point P2 after the movement. The coordinate conversion unit 64 converts the coordinates Q1 to Q4 based on the point P1 acquired by the coordinate acquisition unit 60 into coordinates Q1 to Q4 based on the point P2. The coordinate conversion unit 64 performs coordinate conversion based on the first position information and the second position information acquired by the position information acquisition unit 62.
[0087] The image correction unit 66 corrects the frame image 52 displayed on the display unit 32. The image correction unit 66 corrects the image displayed on the display unit 32 based on the coordinates Q1 to Q4 calculated by the coordinate conversion unit 64 with respect to the point P2. Specifically, the image correction unit 66 calculates the shape and size of the two-dimensional code that is expected when imaged from the operation terminal 30A at the point P2, based on the coordinates Q1 to Q4 with respect to the point P2. The image correction unit 66 generates a frame image 52' that is expected when imaged from the operation terminal 30A after movement, based on the expected shape and size of the two-dimensional code.
[0088] Next, an example of an image correction method by the image correction unit 66 will be described with reference to Fig. 7. Fig. 7 is a schematic diagram showing the flow of an example of an image correction method.
[0089] 7, the image correction method includes a coordinate acquisition step ST90, a first position information acquisition step ST91, a second position information acquisition step ST92, a coordinate conversion step ST93, and a correction step ST94. The image correction is performed, for example, when the position of the operation terminal 30A has moved by a predetermined distance or more.
[0090] In coordinate acquisition step ST90, coordinates of the two-dimensional code of the identification information 7 are acquired with respect to point P1. For example, the coordinates of the four corners Q1 to Q4 of the two-dimensional code of the identification information 7 are measured. The measured coordinates of the four corners Q1 to Q4 are stored in the memory of the control unit 33A. The coordinate acquisition step ST90 is performed, for example, in the imaging step ST20 (FIG. 3).
[0091] In a first position information acquisition step ST91, the position information (first position information) of the operating terminal 30A at point P1 before movement is acquired by the position information acquisition unit 62. The acquired first position information is stored in the storage unit.
[0092] In a second position information acquisition step ST92, the position information (second position information) of the operating terminal 30A at the point P2 after the movement is acquired by the position information acquisition unit 62. The acquired second position information is stored in the storage unit.
[0093] In a coordinate conversion step ST93, the coordinates of the four corners Q1 to Q4 of the two-dimensional code of the identification information 7 are calculated with respect to the point P2 after the movement. Specifically, in the coordinate conversion step ST93, the coordinates of Q1 to Q4 with respect to the point P1 are converted into coordinates of Q1 to Q4 with respect to the point P2, based on the first position information and the second position information.
[0094] In a correction step ST94, the image (frame image 52) to be displayed on the display unit 32 is corrected based on the coordinates Q1 to Q4 calculated in the coordinate conversion step ST93.
[0095] The present disclosure is not limited to the above embodiment, and may be embodied in various other forms. The above-described image correction method is an example, and the image may be corrected by other correction methods based on position information.
[0096] Also, although the case where the identification information 7 is a two-dimensional code has been described, this is not limiting. For example, the identification information 7 may include markers projected at the four corners of the projected image 5. A coordinate conversion may be performed from the coordinates of the four markers based on the point P1 to the coordinates of the four markers based on the point P2, and the image may be corrected based on the result of the coordinate conversion.
[0097] In addition, the image is corrected using the coordinates of the four corners Q1 to Q4 of the two-dimensional code of the identification information 7. However, the image may be corrected using the coordinates of at least three points of the identification information 7 projected onto the projection image 5.
[0098] Moreover, the image correction section 66 may further correct the image of the projection object 3 (captured image 50) according to the position of the operation terminal 30A.
[0099] Any of the above-described various embodiments may be appropriately combined to obtain the effects of each of the embodiments.
[0100] Although the present disclosure has been fully described in connection with the preferred embodiment with reference to the accompanying drawings, various changes and modifications will be apparent to those skilled in the art. Such changes and modifications should be understood to be included within the scope of the present disclosure as defined by the appended claims, unless they deviate from the scope of the present disclosure. In addition, changes in the combination and order of the elements in the embodiments may be made without departing from the scope and spirit of the present disclosure. [Industrial Applicability]
[0101] An image projection system, a control method for an image projection system, and a program according to the present disclosure are useful for a multi-projection system. [Explanation of symbols]
[0102] 1,1A Image Projection System 3. Projection target 5 Projected Image 7 Identification information 10. Projector 11 Projection unit 12 Command receiver 13 Image processing section 14 Input section 15 Correction section 16 Output section 30,30A Operation terminal 31 Imaging unit 32 Display section 33, 33A Control section 34 Information Analysis Department 35 Association section 36 Frame image generation unit 37 Projector control unit 41 1st display section 42 2nd display section 43 Third display section 50 Captured images 60 Coordinate acquisition section 62 Location information acquisition unit 64 Coordinate conversion section 66 Image Correction Section
Claims
1. A plurality of projectors each arranging projection images including area information of the projection areas of the projectors and projecting the images onto a projection target; an imaging unit that captures the projection object and each of the projection images projected onto the projection object by the plurality of projectors; a control unit that generates a region image indicating a region of the projection image based on the region information included in the projection image captured by the imaging unit; a display terminal that displays the region image by superimposing it on an image of the projection target imaged by the imaging unit; An image projection system comprising:
2. The image projection system according to claim 1 , wherein the display terminal selectably displays the area image so as to be superimposed on an image of the projection target imaged by the imaging section.
3. The image projection system according to claim 2 , wherein the projector is adjustable to correspond to the area image selected on the display terminal.
4. The image projection system according to claim 1 , wherein the plurality of projectors project the projection images, each including their own identification information, side by side onto the projection target.
5. The image projection system according to claim 4 , wherein the control unit associates the projection image with the projector that projects the projection image based on the identification information included in the projection image captured by the imaging unit.
6. The image projection system according to claim 4 , wherein the identification information includes a marker projected by the projector onto the projection object.
7. The image projection system according to claim 6 , wherein the control unit generates the area image based on a shape of the marker projected onto the projection object.
8. The image projection system according to claim 6 or 7, wherein the marker includes a two-dimensional code.
9. The image projection system according to claim 4 , wherein the identification information includes a light ID for identifying the projector by modulating light of the projector.
10. The image projection system according to claim 1 , wherein the control unit acquires position information of the display terminal, and corrects the area image displayed on the display terminal based on the position information.
11. The captured image of the projection target displayed on the display terminal is an image captured in real time by the imaging unit, The image projection system according to claim 1 , wherein the display terminal displays the area image by superimposing it on the video.
12. A method for controlling an image projection system including a plurality of projectors, an imaging unit that captures a projection image of the projectors, a display terminal that displays information related to the projection image, and a control unit that controls the projectors, comprising: a projection step of projecting the projection images, including area information of the projection areas of the projectors, on a projection target by arranging the projection images side by side using the plurality of projectors; an imaging step of imaging the projection target and each of the projection images projected onto the projection target by the plurality of projectors with the imaging unit; a region image generating step of generating a region image indicating a region of the projection image of the projector by the control unit based on the region information; a display step of superimposing the area image on an image of the projection target imaged by the imaging unit and displaying the area image on the display terminal; A method for controlling an image projection system, comprising:
13. A program executed by a control unit that controls a plurality of projectors that arrange and project projection images, each including area information of a projection area of the projector, onto a projection target, the area information being information acquired by capturing, with an imaging unit, each of the projection images projected onto the projection target by the plurality of projectors; a region image generating step of generating a region image indicating a region of the projection image of the projector based on the region information; a display step of displaying the area image on a display terminal by superimposing the area image on an image of the projection target captured by the imaging unit; Including, the program.
Citation Information
Patent Citations
Display system, display device and display method
JP2009020390A
Image projection system, control method for the same, terminal device, and program
JP2017116689A
Image projection system, terminal device, and control method for image projection system
JP2019045549A
Projection adjustment program and projection adjustment method
JP2019201362A
Projector, presentation system and control methodthereof
KR1020070052052A
