Projection device and projection method

Abstract

To provide a technique capable of maintaining the relationship between a target image and an object image as intended by a user when the layout of the target image is changed.SOLUTION: A projection device comprises: projection means for projecting a projection image in which a target image is arranged on a projection surface; modification means for modifying the layout of the target image in the projection image; detection means for detecting a user operation on the projection surface; and superimposition means for superimposing the object image according to the user operation detected by the detection means on the projection image. When the layout of the target image is changed by the modification means, the superimposition means superimposes the object image on the projection image in such a manner that the layout of the object image in the projection image is changed in accordance with the change in the layout of the target image.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a projection apparatus and a control method thereof. [Background technology]

[0002] There are projection devices (projectors) known as interactive projectors that generate object images in response to user operations on an image (projected image) containing a target image projected onto a projection surface, and display the object images superimposed on the projection image. Object images are, for example, images containing characters or figures that are drawn by a user operating a pen, finger, or the like on the projection surface. This allows the user to experience the sensation of drawing characters or figures on the image projected onto the projection surface.

[0003] The projection device can also change the layout (position, size, shape, etc.) of the target image in the projected image. For example, it is possible to change the layout from one in which the target image occupies the entire projected image to one in which the target image is displayed in the left half of the projected image.

[0004] Patent Document 1 discloses a technique (projection device) for controlling the character size of text data added to a projected image so that it does not change when the size of the projected image is optically changed. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2017-227800 Summary of the Invention [Problem to be solved by the invention]

[0006] When the layout of a target image in a projected image is changed, the relationship between the object image and the target image (relationships in position, size, shape, etc.) may become misaligned. Specifically, suppose a user writes (adds an object image) to a certain target portion of a projected image that is displayed with the target image occupying the entire projected image. In such a case, when the layout of the target image is changed, the position of the object image becomes misaligned with the position of the target portion of the target image.

[0007] The projection device described in Patent Document 1 controls the projection image so that the character size of the overlaid text data does not change when the size of the projection image changes. When using this technology, the size of the object image does not change even if the layout (size) of the target image in the projection image changes. Therefore, as described above, the relationship between the target image and the object image after the layout change becomes misaligned.

[0008] An object of the present invention is to provide a technique that can maintain the relationship between a target image and an object image as intended by the user when the layout of the target image is changed. [Means for solving the problem]

[0009] A first aspect of the present invention is a projection means for projecting an image for projection on a projection surface, the image including the target image arranged thereon; a change means for changing the layout of the target image in the projection image; a detection means for detecting a user operation on the projection surface; a superimposing means for superimposing an object image corresponding to the user operation detected by the detecting means on the projection image; Equipped with When the layout of the target image is changed by the change means, the superimposing means superimposes the object image on the projection image so that the layout of the object image in the projection image is changed in accordance with the change in the layout of the target image. The projection device is characterized by the above.

[0010] A second aspect of the present invention is a projection step of projecting a projection image on which the target image is arranged onto a projection surface; a changing step of changing a layout of the target image in the projection image; a detection step of detecting a user operation on the projection surface; a superimposing step of superimposing an object image corresponding to the user operation detected in the detecting step on the projection image; and When the layout of the target image is changed in the changing step, the object image is superimposed on the projection image in such a way that the layout of the object image in the projection image is changed in accordance with the change in the layout of the target image in the superimposing step. The present invention relates to a method for controlling a projection device.

[0011] A third aspect of the present invention is a program for causing a computer to function as each of the means of the projection device described above.A fourth aspect of the present invention is a computer-readable storage medium storing a program for causing a computer to function as each of the means of the projection device described above. [Effects of the Invention]

[0012] According to the present invention, when the layout of the target image is changed, the relationship between the target image and the object image can be maintained as intended by the user. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of the configuration of a projection system according to an embodiment. [Figure 2] 1 is a block diagram illustrating an example of the configuration of a projector according to an embodiment of the present invention. [Figure 3] FIG. 2 is a block diagram illustrating an example of the configuration of a processing unit according to the present embodiment. [Figure 4] 10 is a flowchart illustrating an example of a processing flow according to the present embodiment. [Figure 5] FIG. 2 is a schematic diagram showing an example of dual-screen projection according to the present embodiment. [Figure 6] FIG. 2 is a schematic diagram illustrating an example of a layout of an input image according to the present embodiment. [Figure 7] 5A to 5C are schematic diagrams illustrating an example of superimposition processing according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, an embodiment of the present invention will be described.

[0015] <Projection system configuration> FIG. 1 is a schematic diagram showing an example of the configuration of a projection system according to this embodiment. As shown in FIG. 1, the projection system according to this embodiment has a projector 100 (projection device), a screen board 500 (projection surface), and an operation device 600 (instruction device). The projector 100 can project a projection image 300 onto the screen board 500. The projection image 300 has a screen area 400 where a screen is arranged. As shown in FIG. 1, the projection image 300 may also have a non-screen area 700 where no screen is arranged. The screen may have a target image (projection target) and a non-screen area 700 where a screen is arranged. An object image (image of an elephant) is arranged on the screen board 500. The projector 100 can change the layout (position, size, shape, etc.) of the screen area 400, target image, etc. in the projection image 300. The user 200 can perform user operations on the screen board 500 using the operation device 600. The projector 100 superimposes an object image on the projection image 300 in accordance with the user operation on the screen board 500 and projects it onto the screen board 500. For example, the projector 100 projects the object image so that the user 200 can get the feeling of drawing letters or figures on the screen board 500.

[0016] Although the projector 100 is installed above the screen board 500 in FIG. 1 , the positional relationship between the projector 100 and the screen board 500 is not particularly limited. In this embodiment, an example in which the target image is arranged across the entire screen will be described, but the target image may also be arranged on a part of the screen. In this embodiment, an example in which an image input to the projector 100 (input image) is used as the target image will be described, but an image stored in the projector 100, an image generated by the projector 100, etc. may also be used as the target image. The target image may be a still image or a moving image. The target image may be, for example, a captured image, a CG (computer graphics) image, an image for a presentation, an image for a meeting, an image simulating a whiteboard, etc.

[0017] <Projector configuration> FIG. 2 is a block diagram showing an example of the configuration of the projector 100. As shown in FIG.

[0018] The control unit 101 controls the entire projector 100. For example, the control unit 101 is a microcomputer. The ROM 102 is a non-volatile memory, and program codes, data, etc. required for the operation of the control unit 101 are stored in advance in the ROM 102. Data required for the operation of the projector 100 is newly stored in the ROM 102, and data stored in the ROM 102 is updated. The RAM 103 is a volatile memory, and is used as a work memory for the operation of the control unit 101.

[0019] The detection unit 104 detects a user operation on the screen board 500 and outputs the detection result to the processing unit 107 (the object unit 111 described later). In this embodiment, the operation device 600 can emit invisible light (infrared light, ultraviolet light, etc.) having a predetermined wavelength. The user 200 performs a user operation on the screen board 500 by irradiating the screen board 500 with invisible light from the operation device 600. The detection unit 104 detects the invisible light emitted from the operation device 600 and reflected by the screen board 500. The detection unit 104 then notifies the processing unit 107 (the object unit 111 described later) of the coordinates of the position where the invisible light is detected (the position specified by the user operation on the screen board 500). Here, the coordinate system used by the detection unit 104 to detect the invisible light (for example, a coordinate system of real space) may differ from the coordinate system used by the processing unit 107 to perform image processing (for example, a coordinate system of an image (image data)). In this case, the detection unit 104 performs coordinate conversion so that the coordinates of the position where the invisible light is detected are output in a coordinate system used when the processing unit 107 performs image processing.

[0020] It should be noted that the user operation on the screen board 500 is not limited to the above-described user operation. The method of detecting the user operation on the screen board 500 is also not limited to the above-described method. For example, the operation device 600 may emit visible light having a predetermined wavelength, and the detection unit 104 may detect the visible light having the predetermined wavelength. The user operation on the screen board 500 may be a user operation of touching a finger, pen, operation device 600, etc. to the screen board 500, or of reducing the distance between the finger, pen, operation device 600, etc. and the screen board 500 to a threshold value or less. The detection unit 104 may detect the user operation on the screen board 500 based on an image of the screen board 500. For example, the detection unit 104 may detect the operation device 600 from an image of the screen board 500 and output the coordinates of the position where the operation device 600 is detected. The image capturing unit that captures the image of the screen board 500 may be provided in the projector 100, or may be provided in a device (e.g., an image capturing device) different from the projector 100.

[0021] The operation unit 105 accepts user operations on the projector 100. For example, the operation unit 105 is a switch, a button, or the like provided on the housing of the projector 100. The operation unit 105 may be a receiving unit that receives a signal transmitted from a remote controller of the projector 100, for example. When a user operates the projector 100, the operation unit 105 outputs a control signal to the control unit 101 in accordance with the user operation.

[0022] The connection unit 106 connects the projector 100 to external devices such as a personal computer, a tablet terminal, a smartphone, a digital camera, etc. The connection unit 106 may be a communication unit for wireless connection with an external device, or may be a connection terminal for wired connection with an external device. The connection unit 106 acquires image data (input image; target image) from an external device connected to the projector 100 and outputs the acquired image data to the processing unit 107 (layout unit 110, described later). The connection unit 106 can select at least one of multiple external devices connected to the projector 100 and acquire image data from the selected external device in accordance with an instruction from the control unit 101. The connection unit 106 can also select and acquire at least one of multiple image data stored in an external device in accordance with an instruction from the control unit 101. Here, the data format of the image data output from the external device to the connection unit 106 may differ from a data format processable by the processing unit 107. In such a case, the connection unit 106 performs format conversion to output the acquired image data in a data format processable by the processing unit 107. Image data is acquired and processed, for example, at a predetermined frame rate. Image data (image signal) for one frame includes a grayscale signal indicating the grayscale value of each pixel and a synchronization signal indicating the timing of the corresponding frame.

[0023] The processing unit 107 performs various image processing according to instructions from the control unit 101, and generates a projection image 300 (image data) in which the input image is arranged. Then, the processing unit 107 outputs the projection image 300 (image data) to the projection unit 108. The processing unit 107 can perform, as image processing, tone conversion processing (gain processing, offset processing, gamma processing, etc.), frame thinning processing, frame interpolation processing, resolution conversion processing, image synthesis processing, etc. The processing unit 107 can also perform, as image processing, geometric correction processing (keystone correction processing; curved surface correction processing), panel correction processing, layout processing, superimposition processing, object generation processing, etc.

[0024] The projection unit 108 projects the projection image 300 onto the screen board 500 based on the image data output from the processing unit 107. For example, the projection unit 108 has a projection control unit and a projection processing unit. The projection control unit controls the projection processing unit with a control signal based on the image data output from the processing unit 107 so that the projection image 300 is projected. The projection processing unit performs the projection based on the control signal output from the projection control unit. Specifically, the projection processing unit includes a liquid crystal panel, a lens, and a light source. The projection processing unit may include one liquid crystal panel or multiple liquid crystal panels (e.g., three liquid crystal panels). The transmittance (transmittance distribution) of the liquid crystal panel is controlled based on the control signal output from the projection control unit. When light emitted from the light source passes through the liquid crystal panel, an optical image corresponding to the projection image 300 is emitted from the liquid crystal panel onto the screen board 500. In other words, the projection image 300 is projected onto the screen board 500. Furthermore, the projection control unit can adjust the brightness of the projection image 300 by adjusting the light amount of the light source or the like using adjustment parameters (dimming rate, etc.). The adjustment parameters may or may not be set (determined) by the control unit 101 in response to a user operation on the projector 100 (operation unit 105). For example, The parameter may be automatically set by the control unit 101 according to the environment in which the projector 100 is used (such as the brightness around the projector 100).

[0025] The internal bus 109 connects the above-mentioned multiple functional units so that they can communicate with each other. The internal bus 109 functions as a transmission path for the multiple functional units to send and receive various data, various control information, and the like to and from each other.

[0026] <Configuration of operation device> FIG. 2 also schematically illustrates an exemplary configuration of the operating device 600. The operating device 600 is a pen-shaped operating device used to point to any position on the screen board 500. The ON / OFF button 601 is a button for switching ON / OFF of the output of invisible light from the operating device 600. The light-emitting unit 602 emits invisible light in response to a user's operation on the ON / OFF button 601. For example, when the ON / OFF button 601 is pressed while the light-emitting unit 602 is not emitting invisible light, the light-emitting unit 602 emits invisible light. When the ON / OFF button 601 is pressed while the light-emitting unit 602 is emitting invisible light, the light-emitting unit 602 stops outputting the invisible light. The light-emitting unit 602 may emit invisible light only while the ON / OFF button 601 is pressed, and stop outputting the invisible light when the ON / OFF button 601 is released. As described above, the user operation on the screen board 500 is not limited to the user operation using the operation device 600. For example, the user operation on the screen board 500 may be a user operation of pointing a finger at an arbitrary position on the screen board 500.

[0027] <Configuration of the processing unit> Fig. 3 is a block diagram showing an example of the configuration of the processing unit 107. As shown in Fig. 3, the processing unit 107 includes a layout unit 110 that performs layout processing, an object unit 111 that performs object generation processing, and a superimposition unit 112 that performs superimposition processing. Note that the processing unit 107 may further include a functional unit that performs other image processing.

[0028] The layout unit 110 generates a projection image 300 (image data) in which the input image is arranged, based on the image data (input image; target image) output from the connection unit 106. Then, the layout unit 110 outputs the projection image 300 (image data) to the superimposition unit 112. Furthermore, the layout unit 110 can change the layout of the input image in the projection image 300. For example, the layout of the input image may or may not be changed in response to a user operation on the projector 100 (operation unit 105). For example, the layout of the input image may be automatically changed in response to a change in the type, number, etc. of external devices connected to the projector 100.

[0029] 6(A) to 6(F) are schematic diagrams showing examples of input image layouts. In FIG. 6(A), the input image is arranged in a portion of the projection image 300. Therefore, a portion of the projection image 300 becomes the screen area 400 of the input image, and the other portion of the projection image 300 becomes the non-screen area 700. FIG. 6(B) shows a state in which the input image has been enlarged from the state of FIG. 6(A). In FIG. 6(B), the input image is arranged over the entire projection image 300. Therefore, the entire projection image 300 becomes the screen area 400, and there is no non-screen area 700. FIGS. 6(C) and 6(D) show states in which the aspect ratio of the input image has been changed from the state of FIG. 6(A). Specifically, FIG. 6(C) shows a state in which the input image has been enlarged in the vertical direction (lengthwise direction) from the state of FIG. 6(A), and FIG. 6(D) shows a state in which the input image has been enlarged in the horizontal direction (widthwise direction) from the state of FIG. 6(A). In the layout process, not only can the input image be enlarged, but it can also be reduced. Fig. 6(E) shows the state in which the input image has been reduced in the horizontal direction from the state in Fig. 6(A). Figs. 6(A) to 6(E) all show examples of single screen projection (single screen display) in which a single screen on which the input image (target image) is arranged is projected. Fig. 6(F) shows 6(F) shows an example of dual-screen projection (dual-screen display; multi-screen projection) in which two screens are projected, with an input image (target image) placed on one of them. In multi-screen projection, multiple screens, multiple images, etc. are projected side by side. In FIG. 6(F), two screen areas 401 and 402 are arranged on the projection image 300. When switching from the single-screen projection of FIG. 6(A) to the dual-screen projection of FIG. 6(F), the position and size of the screen area 400 in FIG. 6(A) are changed, and the screen area 400 in FIG. 6(A) becomes the screen area 401 or the screen area 402 in FIG. 6(F). In layout processing, the position, size, shape (aspect ratio), etc. of the screen area 400 of the input image can be changed in both single-screen projection and multi-screen projection. In layout processing, the layout of multiple screens can be changed in multi-screen projection.

[0030] Although non-screen area 700 is present in FIG. 6(F), screen areas 401 and 402 may be arranged so that non-screen area 700 does not exist. The number of screens in multi-screen projection may be more than two. The layouts of multiple screens in layout processing may or may not be individually changeable. For example, in response to a change in the layout of one of multiple screens, the layouts of the other screens may be automatically changed.

[0031] The object unit 111 generates an object image (image data) in response to a user operation on the screen board 500, and outputs the object image (image data) to the superimposing unit 112. In this embodiment, the object unit 111 generates the object image so that the object image is projected at a position on the screen board 500 designated by a user operation (a user operation on the screen board 500). Specifically, the object unit 111 performs drawing on coordinates notified by the detection unit 104 to generate the object image. When the position designated by the user operation on the screen board 500 is moved, the drawing is performed so as to trace the trajectory of the designated position. By projecting such an object image, the user 200 can get the feeling of drawing characters or figures on the screen board 500.

[0032] The superimposing unit 112 combines the image data output from the object unit 111 with the image data output from the layout unit 110 so that the object image is superimposed on the projection image 300 on which the input image (target image) is arranged. As a result, the projection image 300 on which the input image is arranged but no object image is arranged is updated to the projection image 300 on which the input image and the object image are arranged. The superimposing unit 112 then outputs the updated projection image 300 (image data obtained by combining) to the projection unit 108.

[0033] 7(A) and 7(B) are schematic diagrams showing an example of the superimposition process of the superimposition unit 112. FIG. 7(A) shows how an object image 800 is superimposed on a projection image 300 (FIGS. 1 and 6(A)) for single-screen projection. In FIG. 7(A), the superimposition process results in a projection image 300 in which the object image 800 is placed at the center of the screen area 400 (input image). FIG. 7(B) shows how the object image 800 is superimposed on a projection image 300 (FIG. 6(F)) for dual-screen projection. In FIG. 7(B), the superimposition process results in a projection image 300 in which the object image 800 is placed at the center of the screen area 401.

[0034] <Projector processing flow> 4 is a flowchart showing an example of a processing flow of the projector 100. When AC power is supplied to the projector 100 via the power cable, power is supplied to the control unit 101 of the projector 100, and the control unit 101 starts up and goes into a standby state. Then, when the control unit 101 detects that a start-up instruction has been received from the user, the processing flow of FIG. 4 is started. For example, when the control unit 101 receives a signal output from a power switch (operation unit 105) provided on the projector 100 in response to pressing of the power button provided on the remote controller of the projector 100, the processing flow of FIG. 4 is started. 4 may be started by the control unit 101 receiving, via the receiving unit (operation unit 105), a signal output from the remote controller in response to the command. The processing flow of FIG. 4 may be started by the control unit 101 receiving, via the connection unit 106, a control command output from an external device (control device) connected to the projector 100.

[0035] In step S100, the control unit 101 performs a start-up process for each functional unit of the projector 100. Specifically, the control unit 101 controls the supply of power to each functional unit and sets each functional unit to be operable. Then, the control unit 101 controls the light source of the projection unit 108 to be turned on and the cooling fan that cools the inside of the projector 100 to be driven. This starts the projection of the input image acquired by the connection unit 106 (specifically, the projection image 300 in which the input image is arranged and the object image 800 is not arranged).

[0036] In step S101, the control unit 101 inquires of the detection unit 104 and determines whether or not a user operation (drawing operation) on the screen board 500 has been detected. If a drawing operation has been detected, the process proceeds to step S102, and if a drawing operation has not been detected, the process proceeds to step S103. If a drawing operation has been detected, the object unit 111 generates an object image 800.

[0037] In step S102, the control unit 101 instructs the superimposing unit 112 to perform the superimposing process. As a result, the superimposing unit 112 performs the superimposing process, and the projection image 300, in which the input image is arranged but the object image 800 is not arranged, is updated to the projection image 300 in which the input image and the object image 800 are arranged.

[0038] In step S103, the control unit 101 queries the operation unit 105 and determines whether or not a user operation (layout change operation) for changing the layout of the input image in the projection image 300 has been detected. If a layout change operation has been detected, the process proceeds to step S104; if a layout change operation has not been detected, the process proceeds to step S108.

[0039] In step S104, the control unit 101 inquires of the superimposing unit 112 and determines whether or not the superimposing process is being performed. If the superimposing process is being performed, the process proceeds to step S105, and if the superimposing process is not being performed, the process proceeds to step S106.

[0040] In each of steps S105 and S106, the control unit 101 instructs the layout unit 110 to change the layout of the input image in the projection image 300. As a result, the layout unit 110 performs layout processing (layout change processing) and changes the layout of the input image. Here, assume that the user presses the dual-screen projection button (operation unit 105) while the single-screen projection of FIGS. 1 and 6(A) is being performed. When the control unit 101 receives a signal output from the operation unit 105 in response to the pressing of the dual-screen projection button, it instructs the layout unit 110 to switch to dual-screen projection. Then, the layout unit 110 changes the layout of the input image, etc., so that the dual-screen projection of FIG. 5 (FIG. 6(F)) is performed.

[0041] The layout of the input image (target image) may be changed by a process different from the process of switching from single-screen projection to multi-screen projection. For example, the layout of the input image may be changed by switching from multi-screen projection to single-screen projection. In other words, the layout of the input image may be changed by switching from one of single-screen projection and multi-screen projection to the other. The position, size, and aspect ratio of the input image in the projection image 300 may be changed. The layout of the input image may be changed by changing at least one of the above, changing the layout of multiple screens in multi-screen projection, or the like.

[0042] Here, the relationship (relationship in position, size, shape, etc.) between the input image and the object image 800 in the projection image 300 before the layout of the input image is changed is the relationship intended by the user. If the layout of the input image is changed without changing the layout of the object image 800, the relationship between the input image and the object image 800 in the projection image 300 will also change. In other words, if the layout of the input image is changed, the relationship between the input image and the object image 800 will deviate from the relationship intended by the user. Therefore, in this embodiment, the process of step S107 is performed.

[0043] In step S107, the control unit 101 instructs the object unit 111 to change the layout of the object image 800 in the projection image 300 in accordance with the change in the layout of the input image in the projection image 300. As a result, the object unit 111 updates the object image 800 so that the layout of the object image 800 is changed in accordance with the change in the layout of the input image (object update processing). Note that the control unit 101 may also instruct the superimposing unit 112 to change the layout of the object image 800. Then, the superimposing unit 112 may process the object image 800 and superimpose it on the projection image 300 so that the layout of the object image 800 is changed.

[0044] In this embodiment, the layout of the object image 800 is changed so that the change in the layout of the object image 800 matches the change in the layout of the target image. Here, consider a case where a switch is made from the single-screen projection of FIG. 7A, in which the object image 800 is placed at the center of the screen area 400 (input image), to a dual-screen projection. The screen area 400 is moved to the left and reduced to become the screen area 401. If the processing of step S107 is not performed, the layout of the object image 800 will remain unchanged from the layout of FIG. 7A, and will be projected in a larger size at a position shifted from the center of the screen area 401 (input image) as shown in FIG. 7C. In this embodiment, the processing of step S107 moves the object image 800 to the left by the same amount as the screen area 400, and reduces it at the same reduction rate as the screen area 400. As a result, as shown in Fig. 7(B), the object image 800 can be projected at the center of the screen area 401 (input image) without changing the relationship (relationship in position, size, shape, etc.) between the input image and the object image 800 from Fig. 7(A). In other words, the relationship between the input image and the object image 800 can be maintained as intended by the user.

[0045] When the aspect ratio of the input image is changed, the aspect ratio of the object image 800 is also changed in the same way as when the aspect ratio of the input image is changed. For example, when the input image is enlarged in the vertical direction, the object image 800 is enlarged at the same enlargement ratio as the enlargement ratio of the input image (vertical enlargement ratio). When the input image is reduced in the horizontal direction, the object image 800 is reduced at the same reduction ratio as the reduction ratio of the input image (horizontal enlargement ratio).

[0046] Note that the method for changing the layout of the object image 800 is not limited to the above method. For example, the change in the layout of the object image 800 does not have to match the change in the layout of the target image. The layout of the object image 800 may be changed so that the difference between the change in the layout of the target image and the change in the layout of the object image 800 is equal to or smaller than a threshold. The threshold may be set so that the change in the layout of the object image 800 is similar to the change in the layout of the target image.

[0047] In step S108, the control unit 101 queries the operation unit 105 and determines whether a user operation (termination operation) for terminating the process flow of FIG. 4 has been detected. If the termination operation has been detected, the control unit 101 performs termination processing for each functional unit of the projector 100. Specifically, the control unit 101 performs control to stop the supply of power to each functional unit of the projector 100. This causes the control unit 101 to return to a standby state, and the process flow of FIG. 4 is terminated. If the termination operation has not been detected, the process returns to step S101.

[0048] As described above, according to this embodiment, when the layout of the target image in the projection image is changed, the layout of the object image in the projection image is changed in accordance with the change in the layout of the target image. This makes it possible to maintain the relationship between the target image and the object image as intended by the user when the layout of the target image is changed.

[0049] Note that each functional unit in this embodiment (FIG. 2) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of multiple functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware. For example, the device may have a processor and a memory in which a control program is stored. Then, the functions of at least some of the functional units of the device may be realized by the processor reading and executing the control program from the memory.

[0050] It should be noted that this embodiment (including the above-mentioned modified examples) is merely an example, and configurations obtained by appropriately modifying or changing the configuration of this embodiment within the scope of the gist of the present invention are also included in the present invention.

[0051] <Other embodiments> The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0052] 100: Projector 101: Control unit 104: Detection unit 108: Projection unit 110: Layout section 111: Object section 112: Superimposition section

Claims

1. a projection means for projecting an image for projection on a projection surface, the image including the target image arranged thereon; a change means for changing the layout of the target image in the projection image; a detection means for detecting a user operation on the projection surface; a superimposing means for superimposing an object image corresponding to the user operation detected by the detecting means on the projection image; Equipped with When the layout of the target image is changed by the change means, the superimposing means superimposes the object image on the projection image so that the layout of the object image in the projection image is changed in accordance with the change in the layout of the target image. A projection device characterized by:

2. When the layout of the target image is changed by the change means, the superimposition means changes the layout of the object image so that a difference between the change in the layout of the target image and the change in the layout of the object image is equal to or smaller than a threshold.

2. The projection device according to claim 1.

3. When the layout of the target image is changed by the change means, the superimposition means changes the layout of the object image so that the change in the layout of the object image matches the change in the layout of the target image.

2. The projection device according to claim 1.

4. The change means is changing at least one of the position, size, and aspect ratio of the target image in the projection image; Switching from one to the other of single-screen projection, which projects one screen on which the target image is arranged, and multi-screen projection, which projects multiple screens on which the target image is arranged, or By changing the layout of the plurality of screens in the multi-screen projection, Change the layout of the target image 4. The projection device according to claim 1, wherein the projection device is a projection device having a projection lens.

5. the user operation is a user operation of irradiating the projection surface with light having a predetermined wavelength, The detecting means detects light having the predetermined wavelength.

5. The projection device according to claim 1, wherein the projection device is a projection device having a projection lens.

6. The light having the predetermined wavelength is invisible light.

6. The projection device according to claim 5.

7. The light having the predetermined wavelength is visible light.

6. The projection device according to claim 5.

8. The detection means detects the user operation based on an image captured of the projection surface.

5. The projection device according to claim 1, wherein the projection device is a projection device having a projection lens.

9. The superimposing means superimposes the object image on the projection image in response to the user operation so that the object image is projected onto the projection surface at a position designated by the user operation.

9. The projection device according to claim 1, wherein the projection device is a projection device having a projection lens.

10. The superimposing means generates the object image in response to the user operation and superimposes the object image on the projection image.

10. The projection device according to claim 1, wherein the projection device is a projection device having a projection lens.

11. The target image is a still image.

11. The projection device according to claim 1.

12. The target image is a video 11. The projection device according to claim 1.

13. a projection step of projecting a projection image on which the target image is arranged onto a projection surface; a changing step of changing a layout of the target image in the projection image; a detection step of detecting a user operation on the projection surface; a superimposing step of superimposing an object image corresponding to the user operation detected in the detecting step on the projection image; and When the layout of the target image is changed in the changing step, the object image is superimposed on the projection image in such a way that the layout of the object image in the projection image is changed in accordance with the change in the layout of the target image in the superimposing step.

2. A method for controlling a projection device.

14. A program for causing a computer to function as each of the means of the projection device according to any one of claims 1 to 12.

15. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the projection device according to any one of claims 1 to 12.

Images