Display method, information processing apparatus, and program product

Abstract

The invention provides a display method, an information processing apparatus, and a program product, which improve user convenience. The display method includes: projecting a first image including a first graphic from a projection device; displaying, by the information processing device, a second image including a second graph corresponding to the first graph on a display device different from the projection device; when a movement operation for moving the position of the first graph is accepted by the information processing device, the information processing device associates a movement display indicating that the first graph moves in the first image with the second graph and displays the movement display on the second image; and projecting the moved first pattern from the projection device.

Description

Technical Field

[0001] The present invention relates to a display method, an information processing apparatus, and a program product. Background Art

[0002] There is known a technique for correcting an image projected by a projection device through remote operation of an information processing device.

[0003] For example, Patent Document 1 discloses a parameter generation device that generates deformation parameters used in a projection device having a geometric correction unit.

[0004] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2019-125955

[0005] However, in the case of correcting an image projected by a projection device through remote operation of an information processing device, even when a user operates the information processing device, it is sometimes difficult to know whether the operation result of the user is reflected in the image projected by the projection device. For example, when a part of the image projected by the projection device is displayed offset from a screen or the like that is the projection target, it is sometimes difficult for the user to recognize the change in the image displayed outside the screen. Summary of the Invention

[0006] The present disclosure is a display method in a projection system including a projection device and an information processing device, the display method including: projecting a first image including a first graphic from the projection device; displaying a second image including a second graphic corresponding to the first graphic on a display device different from the projection device by the information processing device; when a movement operation for moving the position of the first graphic is received by the information processing device, associating a movement display indicating that the first graphic moves in the first image with the second graphic and displaying the movement display on the second image by the information processing device; and projecting the moved first graphic from the projection device.

[0007] The present disclosure is an information processing device including one or more processors that control a display device, the one or more processors performing the following processing: displaying a second image including a second graphic on the display device, the second graphic corresponding to a first graphic included in a first image projected from a projection device; when a movement operation for moving the position of the first graphic is received, associating a movement display indicating that the first graphic moves in the first image with the second graphic corresponding to the first graphic selected by the movement operation and displaying the movement display on the second image; and sending a projection instruction of the moved first graphic to the projection device.

[0008] The present disclosure is a program product that causes a processor of an information processing device mounted on a control display device to perform the following processing: displaying a second image including a second graphic on the display device, the second graphic corresponding to a first graphic included in a first image projected from a projection device; when a movement operation for moving the position of the first graphic is received, displaying a movement display indicating the movement of the first graphic on the first image in association with the second graphic on the second image; and sending a projection instruction for the moved first graphic to the projection device. Description of the Drawings

[0009] Figure 1 FIG. is a diagram showing the system configuration of a projection system.

[0010] Figure 2 FIG. is a block diagram showing the configuration of a projector.

[0011] Figure 3 FIG. is a block diagram showing the configuration of an information processing device.

[0012] Figure 4 FIG. is an example diagram showing an APP screen.

[0013] Figure 5 FIG. is a diagram showing an adjustment image projected onto a projection object.

[0014] Figure 6 FIG. is a diagram showing a state in which a second graphic is selected.

[0015] Figure 7 FIG. is a diagram showing a third graphic.

[0016] Figure 8 FIG. is a flowchart showing the operation of the information processing device.

[0017] Figure 9 FIG. is a diagram showing a first display example of a setting screen.

[0018] Figure 10 FIG. is a diagram showing a second display example of a setting screen.

[0019] Figure 11 FIG. is a diagram showing a third display example of a setting screen.

[0020] Figure 12 FIG. is a diagram showing a fourth display example of a setting screen.

[0021] Figure 13 FIG. is a diagram showing a fourth display example of a setting screen.

[0022] Figure 14 FIG. is a diagram showing a fifth display example of a setting screen.

[0023] Reference Signs Explanation

[0024] 1: Projection system; 5: Mouse cursor; 10: Cable; 30: Projection object; 40: Projectable range; 50: Adjusted image; 51, 51A, 51B, 51C, 51D: First graphic; 60: Projection range; 100: Projector; 105: Remote control; 110: Light-receiving part of remote control; 120: First communication I / F; 130: Image processing unit; 135: Frame memory; 140: Projection unit; 150: Shooting unit; 160: First control unit; 170: First storage unit; 175: Control program; 180: First processor; 200: Information processing device; 210: Second communication I / F; 221: Input I / F; 223: Mouse; 225: Keyboard; 250: Second control unit; 260: Second storage unit; 265: Control program; 265A: OS; 265B: APP; 270: Second processor; 300: APP screen; 301, 301A, 301B, 301C, 301D: Second graphic; 303: Rectangular graphic; 305: Third graphic; 307, 307A, 307B, 307C, 307D: Arrow image; 309: Range image; 310: First area; 315: Setting screen; 307B: Downward arrow image; 320: Magnified image; 321A: Magnified second graphic; 323: Magnified rectangular graphic; 325: Magnified third graphic; 329: Magnified range image; 330: Fourth graphic; 351: On button; 353: Off button; 335: Projection button; 340: Second area; 350: Switch display; 362, 364: Operating parts; 370: Lens shift; 371, 372, 373, 374: Arrow keys; 380: Coordinate display; 390: Selection graphic display. Detailed implementation

[0025] 1. Structure of the projection system

[0026] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0027] Figure 1 FIG. shows the system structure of the projection system 1.

[0028] The projection system 1 includes a projector 100 and an information processing device 200. The information processing device 200 and the projector 100 are connected by a cable 10. Figure 1 An example of a wired connection between the information processing device 200 and the projector 100 through the cable 10 is shown, but the connection between the information processing device 200 and the projector 100 can also be wireless. In addition, the information processing device 200 and the projector 100 can be connected via a network. The projector 100 is an example of a projection device.

[0029] The projector 100 displays an image on the projection object 30 by projecting image light onto the projection object 30. The projection object 30 may be a screen in the shape of a curtain, or the wall surface of a building or the surface of a fixture.

[0030] The information processing device 200 supplies a signal including image data to be displayed by the projector 100 to the projector 100. The signal including image data sent from the information processing device 200 to the projector 100 is referred to as a display signal. The information processing device 200 uses, for example, a personal computer such as a desktop computer or a laptop computer, a portable terminal such as a smartphone or a tablet computer.

[0031] 2. Structure of the Projector

[0032] Figure 2 It is a block diagram showing the structure of the projector 100.

[0033] Refer to Figure 2 The structure of the projector 100 will be described.

[0034] The projector 100 includes an infrared remote control light receiving unit 110, a first communication interface 120, an image processing unit 130, a frame memory 135, a projection unit 140, a photographing unit 150, and a first control unit 160. Hereinafter, the interface will be abbreviated as I / F.

[0035] The remote control light receiving unit 110 is a receiving device for infrared signals and includes a light receiving element (not shown), a decoder, etc. The remote control light receiving unit 110 receives the infrared signal sent from the remote control 105 and decodes it. The remote control light receiving unit 110 decodes the infrared signal and outputs an instruction signal corresponding to the operated operation key or button of the remote control 105 to the first control unit 160. The remote control light receiving unit 110 may also be configured to receive a wireless signal such as Bluetooth from the remote control 105. In the case of receiving a wireless signal, the remote control light receiving unit 110 may also include an antenna and a receiving circuit. Bluetooth is a registered trademark.

[0036] The first communication I / F 120 is connected to the information processing device 200 via the cable 10 and performs data communication with the information processing device 200. The first communication I / F 120 is, for example, a wired interface having connection terminals such as a USB (Universal Serial Bus) connector and an Ethernet connector, and an interface circuit. The first communication I / F 120 may also be a wireless communication interface. The first communication I / F 120 receives the display signal and extracts the image data included in the received display signal. The first communication I / F 120 outputs the extracted image data to the image processing unit 130. Ethernet is a registered trademark.

[0037] The image processing unit 130 is connected to the frame memory 135. The frame memory 135 has a plurality of banks. Each bank has a storage capacity capable of writing an amount of image data for one frame. The frame memory 135 is constituted by, for example, SDRAM (Synchronous Dynamic RAM). The image processing unit 130 loads the image data input from the first communication I / F 120 into the frame memory 135.

[0038] The image processing unit 130 loads the image data input from the first communication I / F 120 into the frame memory 135. The image processing unit 130 processes the image data loaded into the frame memory 135 in synchronization with the synchronization signal input from the first communication I / F 120.

[0039] The image processing performed by the image processing unit 130 includes, for example, resolution conversion processing, size adjustment processing, correction of distortion aberration, shape correction processing, digital zoom processing, adjustment of image tone or brightness, etc. The image processing unit 130 executes the processing specified by the first control unit 160 and performs processing using the parameters input from the first control unit 160 as needed. In addition, the image processing unit 130 can of course execute a combination of multiple image processings described above.

[0040] The image processing unit 130 and the frame memory 135 are constituted by, for example, integrated circuits. The integrated circuits include LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), FPGA (Field-Programmable Gate Array), SoC (System-on-a-chip), etc. In addition, an analog circuit can be included in a part of the structure of the integrated circuit, or it can be a structure that combines the first control unit 160 and the integrated circuit.

[0041] The projection unit 140 is connected to the first control unit 160. The projection unit 140 includes, for example, a light source, a light modulation device, and a projection optical system. The light source is lit under the control of the first control unit 160 and emits light toward the light modulation device. The specific structure of the light source is not limited. For example, the light source may include lamps such as halogen lamps, xenon lamps, and ultra-high pressure mercury lamps, or solid light sources such as LEDs and laser light sources. The light modulation device modulates the light emitted by the light source. The specific structure of the light modulation device is not limited. For example, the light modulation device can be composed of a transmissive liquid crystal panel, a reflective liquid crystal panel, or a digital micromirror device (Digital Micromirror Device). In the present embodiment, the case where the light modulation device has a transmissive liquid crystal panel will be described. The projection optical system included in the projection unit 140 has lenses, mirrors, prisms, etc. that image the image light modulated by the light modulation device on the projection target 30.

[0042] The projection unit 140 may also include a light source drive circuit that supplies power to the light source and a drive circuit that causes the light modulation device to perform drawing. The projection unit 140 may also include a zoom mechanism, a focus adjustment mechanism for adjusting focus, etc.

[0043] The imaging unit 150 is a camera including an imaging element (not shown) such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The imaging unit 150 repeatedly performs imaging under the control of the first control unit 160 and sequentially outputs the captured images as the imaging results to the first control unit 160.

[0044] The first control unit 160 is a computer device including a first storage unit 170 and a first processor 180.

[0045] The first storage unit 170 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). The RAM is used for temporarily storing various data, etc., and the ROM stores a control program 175 for controlling the operation of the projector 100, various setting information, etc.

[0046] The first processor 180 is an arithmetic processing device composed of a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The first processor 180 executes the control program 175 to control each part of the projector 100. The first processor 180 can be composed of a single processor or multiple processors. In addition, the first processor 180 can also be composed of an SoC integrated with a part or all of the first storage unit 170 and other circuits. In addition, the first processor 180 can also be composed of a combination of a CPU that executes a program and a DSP that executes predetermined arithmetic processing. Moreover, either a structure in which all the functions of the first processor 180 are installed in hardware or a programmable device can be used to form it.

[0047] 3. Structure of the information processing device

[0048] Figure 3 It is a block diagram showing the structure of the information processing device 200.

[0049] Refer to Figure 3 The structure of the information processing device 200 will be described.

[0050] The information processing device 200 includes a second communication I / F 210, an input I / F 221, a mouse 223, a keyboard 225, a display unit 230, and a second control unit 250.

[0051] The second communication I / F 210 is connected to the projector 100 via the cable 10 and performs data communication with the projector 100. The second communication I / F 210 is, for example, a wired interface having connection terminals such as a USB connector and an Ethernet connector and an interface circuit. The second communication I / F 210 can also be a wireless communication interface. Ethernet is a registered trademark.

[0052] The input I / F 221 is connected to the mouse 223 and the keyboard 225 as input devices and accepts operations of these input devices. The input I / F 221 outputs an operation signal corresponding to the accepted operation to the second control unit 250. The second control unit 250 determines that an operation has been accepted by receiving the operation signal. The mouse 223 corresponds to the first operation device, and the keyboard 225 corresponds to the second operation device.

[0053] The mouse 223 accepts operations such as clicking the left button and drag-and-drop as operations in the first mode. The keyboard 225 accepts operations of the cursor keys as operations in the second mode.

[0054] The display unit 230 includes a display panel 235, and displays an image on the display panel 235 under the control of the second control unit 250. The display panel 235 uses, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. The display panel 235 corresponds to a display device.

[0055] The second control unit 250 includes a second storage unit 260 and a second processor 270.

[0056] The second storage unit 260 includes volatile memories such as a RAM and non-volatile memories such as a ROM. In addition, the second storage unit 260 includes auxiliary storage devices such as an SSD (Solid State Drive) and an HDD (Hard Disk Drive).

[0057] The second storage unit 260 stores control programs 265 such as an OS (Operating System) 265A and an application program 265B executed by the second processor 270. Hereinafter, the application program 265B is referred to as APP 265B.

[0058] The second processor 270 is an arithmetic processing device composed of a CPU and an MPU. The second processor 270 executes the OS 265A and the APP 265B to control each part of the information processing device 200. The second processor 270 may be composed of a single processor or multiple processors. In addition, the second processor 270 may be composed of an SoC integrated with a part or all of the second storage unit 260 and other circuits. In addition, the second processor 270 may be composed of a combination of a CPU that executes a program and a DSP that executes a specified arithmetic process. Moreover, a structure in which all functions of the second processor 270 are installed in hardware may be adopted, or a programmable device may be used to form it.

[0059] 4. Operations of the Information Processing Device and the Projector

[0060] Next, the operations of the information processing device 200 and the projector 100 will be described.

[0061] When the information processing device 200 receives an operation of selecting the APP 265B through the input I / F 221, the second control unit 250 executes the selected APP 265B. The APP 265B is an APP that sets the range in which the projector 100 can project image light, that is, the projectable range 40, and is the range in which the display image is actually displayed. The range in which the display image is actually displayed is called the projection range 60. The projectable range 40 indicates the range in which the image can be projected when the display image is displayed over the entire area of the transmissive liquid crystal panel. Refer to Figure 5The projectable range 40 and the projection range 60 are described.

[0062] Figure 4 It is a diagram showing an example of the APP screen 300 displayed on the display panel 235 of the information processing apparatus 200.

[0063] The second control unit 250 executes the APP 265B to cause the display panel 235 to display Figure 4 the APP screen 300 shown. Figure 4 It is a diagram showing an example of the APP screen 300.

[0064] The APP screen 300 includes a first area 310 and a second area 340. In addition, a projection button 335 for instructing the projection adjustment image 50 is displayed on the APP screen 300.

[0065] The setting screen 315 is displayed in the first area 310. A setting image 316 including a second graphic 301 is displayed in the setting screen 315. The setting image 316 corresponds to the second image. The second graphic 301 is a graphic for setting the projection range 60. The number and position of the second graphic 301 displayed on the setting screen 315 can be changed by the user operating the second area 340. In Figure 4 it, as the second graphic 301, an example is shown in which four second graphics 301 are arranged at the four corners of the setting screen 315. In the drawing view, the second graphic 301 located at the upper left of the setting screen 315 is labeled as the second graphic 301A, and the second graphic 301 located at the upper right of the setting screen 315 is labeled as the second graphic 301B. In addition, in the drawing view, the second graphic 301 located at the lower left of the setting screen 315 is labeled as the second graphic 301C, and the second graphic 301 located at the lower right of the setting screen 315 is labeled as the second graphic 301D.

[0066] In Figure 4 it, as the second graphic 301, an example of a graphic showing a cross shape is shown, but the shape of the second graphic 301 is arbitrary. In addition, in Figure 4 it, a case is shown where the shapes of the second graphics 301A, 301B, 301C, and 301D are all the same, but at least one of the shapes or colors of the second graphics 301A, 301B, 301C, and 301D may be different.

[0067] The switching display 350, the graphic number setting display 360, the lens shift 370, the coordinate display 380, and the selection graphic display 390 are displayed in the second area 340.

[0068] The switching display 350 is a display of an operation for determining whether to display the second graphic 301 on the setting screen 315. The on button 351 and the off button 353 are displayed in the switching display 350. When the on button 351 is selected, the second graphic 301 is displayed on the setting screen 315. When the off button 353 is selected, the second graphic 301 displayed on the setting screen 315 is deleted.

[0069] The graphic number setting display 360 is a display of an operation for setting the number of the second graphics 301 displayed on the setting screen 315.

[0070] In the graphic number setting display 360, a display bar 361 for displaying the number of the second graphics 301 displayed longitudinally on the setting screen 315 in the drawing view and an operating element 362 for accepting an operation for changing the number of the second graphics 301 displayed longitudinally on the setting screen 315 are displayed.

[0071] In addition, in the graphic number setting display 360, a display bar 363 for displaying the number of the second graphics 301 displayed horizontally on the setting screen 315 in the drawing view and an operating element 364 for accepting an operation for changing the number of the second graphics 301 displayed horizontally on the setting screen 315 are displayed.

[0072] In the lens shift 370, arrow keys 371, 372, 373, and 374 corresponding to the up, down, left, and right directions are displayed. By operating the arrow keys 371, 372, 373, and 374 with the mouse 223, the user can send an instruction to the projector 100 to shift the position of the projection lens included in the projection optical system of the projection unit 140 of the projector 100. Thereby, the position of the image projected by the projection unit 140 onto the projection target 30 can be changed.

[0073] In the coordinate display 380, when the first graphic 51 corresponding to the second graphic 301 selected by the user is moved on the adjustment image 50, the amount of movement on the adjustment image 50 is displayed.

[0074] The coordinate display 380 includes a vertical movement amount and a horizontal movement amount. The vertical movement amount is the amount of movement in the vertical direction of the adjustment image 50, and the horizontal movement amount is the amount of movement in the horizontal direction of the adjustment image 50. The coordinate display 380 is an example of a movement display. In addition, the coordinate display 380 is an example of a direction display. In addition, the coordinate display 380 is an example of a movement amount display for indicating the movement amount of the first graphic.

[0075] In the selected graphic display 390, the consecutive number of the second graphic 301 selected by the user's operation among the second graphics 301 displayed on the setting screen 315 is displayed.

[0076] As shown Figure 4 in the figure, consecutive numbers are respectively displayed for the second graphics 301A, 301B, 301C, and 301D displayed at the four corners of the setting screen 315. The consecutive numbers of the second graphic selected by the user among these second graphics 301 are displayed in the select graphic display 390.

[0077] Figure 5 It is a diagram showing the adjusted image 50 projected onto the projection object 30.

[0078] The adjusted image 50 includes the first graphic 51. The adjusted image 50 is an example of the first image. Figure 5 An example is shown where the first graphics 51 are respectively displayed at the four corners of the adjusted image 50. In the drawing view, the first graphic 51 located at the upper left of the adjusted image 50 is labeled as the first graphic 51A, and the first graphic 51 located at the upper right of the adjusted image 50 is labeled as the first graphic 51B. Additionally, in the drawing view, the first graphic 51 located at the lower left of the adjusted image 50 is labeled as the first graphic 51C, and the first graphic 51 located at the lower right of the adjusted image 50 is labeled as the first graphic 51D.

[0079] The first graphic 51 corresponds to the second graphic displayed on the setting screen 315.

[0080] Figure 4 In the shown setting screen 315, the second graphic 301A displayed corresponds to the first graphic 51A, and the second graphic 301B displayed corresponds to the first graphic 51B. Additionally, the second graphic 301C displayed on the setting screen 315 corresponds to the first graphic 51C, and the second graphic 301D displayed on the setting screen 315 corresponds to the first graphic 51D.

[0081] The display position of the first graphic 51A in the adjusted image 50 corresponds to the position of the second graphic 301A in the setting screen 315.

[0082] The display position of the first graphic 51B in the adjusted image 50 corresponds to the position of the second graphic 301B in the setting screen 315.

[0083] The display position of the first graphic 51C in the adjusted image 50 corresponds to the position of the second graphic 301C in the setting screen 315.

[0084] The display position of the first graphic 51D in the adjusted image 50 corresponds to the position of the second graphic 301D in the setting screen 315.

[0085] The first graphics 51A, 51B, 51C, and 51D are graphics that define the projection range 60, which is the range where the projector 100 actually displays the display image within the projectable range 40.

[0086] For example, as Figure 5 shown, the area divided by the line segments connecting the centers of the first figures 51A, 51B, 51C, and 51D disposed at the four corners of the adjustment image 50 is set as the projection range 60.

[0087] When the user presses the projection button 335 displayed on the APP screen 300, the second control unit 250 generates adjustment image data that is the basis of the adjustment image 50, and sends the generated adjustment image data to the projector 100. The projector 100 generates image light based on the received adjustment image data, and projects the generated image light onto the projection target 30. Thereby, the adjustment image 50 is displayed on the projection target 30.

[0088] While visually confirming the adjustment image 50 projected onto the projection target 30 and the display panel 235, the user operates the input device to perform an operation on the second figure 301, that is, change the position of the second figure 301 in the setting screen 315. In other words, the information processing apparatus 200 receives an operation on the second figure 301 from the user. By changing the position of the second figure 301 in the setting screen 315, the position of the first figure 51 in the adjustment image 50 is also changed, and the projection range 60 is changed.

[0089] At this time, when the projection target 30 onto which the projector 100 projects an image is not a screen but, for example, the wall surface or curved surface of a building, sometimes a part of the adjustment image 50 is displayed outside the projection target 30. When a part of the adjustment image 50 displayed outside the projection target 30 includes the first figure 51, the visibility of the first figure 51 is reduced. Therefore, even if the user operates the information processing apparatus 200 to change the display position of the first figure 51, sometimes it is difficult for the user to grasp whether the display position of the first figure 51 has been changed.

[0090] Next, an operation of operating the setting screen 315 to change the display position of the first figure 51 in the adjustment image 50 will be described.

[0091] Figure 6 is a diagram showing a state in which the second figure 301A is selected.

[0092] First, the user operates the mouse 223 to overlap the mouse cursor 5 on the second figure 301 corresponding to the first figure 51 whose display position is to be changed. By the user left-clicking the mouse 223, the second figure 301 overlapped by the mouse cursor 5 is selected.

[0093] When the second control unit 250 receives an operation of selecting any one of the second figures 301 by a left-click operation of the mouse 223, as Figure 6As shown, the projector 100 is made to display a rectangular figure 303 around the selected second figure 301. Figure 6 It represents a state where the second figure 301A is selected and the periphery of the second figure 301A is surrounded by the rectangular figure 303. In addition, in the selection figure display 390, "1", which is the consecutive number of the selected second figure 301A, is displayed.

[0094] Figure 7 It is a diagram showing the third figure 305.

[0095] Next, the movement operation using the mouse 223 will be described.

[0096] The user moves the mouse cursor 5 to the position where the second figure 301 is to be displayed by the drag-and-drop operation of the mouse 223. Specifically, the user presses the left button of the mouse 223 while the mouse cursor 5 overlaps with the selected second figure 301, moves the mouse cursor 5 to the position where the second figure 301 is to be displayed while keeping the left button of the mouse 223 pressed, and releases the press of the left button of the mouse 223 at the position to which it is desired to move. The drag-and-drop operation is equivalent to the operation of specifying the position after the movement of the first figure 51.

[0097] The second control unit 250 displays the third figure 305 at the position where the press of the left button of the mouse 223 is released. The third figure 305 is a figure congruent or similar to the second figure 301.

[0098] When the second control unit 250 causes the third figure 305 to be displayed on the setting screen 315, it gradually moves the display position of the first figure 51A corresponding to the selected second figure 301A.

[0099] The second control unit 250 calculates the moving direction and the moving amount when moving the second figure 301A from the current position to the position of the third figure 305 on the setting screen 315. The second control unit 250 moves the position of the first figure 51A in the adjustment image 50 projected by the projector 100 according to the calculated moving direction and moving amount.

[0100] The resolution of the setting screen 315 is different from the panel resolution of the transmissive liquid crystal panel included in the light modulation device. Therefore, the second control unit 250 converts the moving direction and the moving amount calculated on the setting screen 315 into the moving direction and the moving amount in the transmissive liquid crystal panel according to the resolution of the setting screen 315 and the panel resolution of the transmissive liquid crystal panel.

[0101] Next, when the second control unit 250 acquires the moving direction and the moving amount in the transmissive liquid crystal panel, the second control unit 250 sequentially generates adjustment image data obtained by moving the position of the first graphic 51A included in the adjustment image 50 by a preset moving amount in the acquired moving direction. The second control unit 250 outputs the sequentially generated adjustment image data to the projector 100, and causes the projector 100 to project the adjustment image 50 based on the adjustment image data.

[0102] In addition, the second control unit 250 may not change the display position of the second graphic 301A on the setting screen 315 during the movement of the first graphic 51A. That is, the position of the second graphic 301A in the setting screen 315 when the position of the first graphic 51A is the first position before the change and the position of the second graphic 301 when the position of the first graphic 51A is the second position different from the first position may be the same. When projecting the adjustment image 50 with a building such as a curved surface or a building as the projection object 30, even if the first graphic 51A and the second graphic 301A are moved, the movement of the first graphic 51A in the adjustment image 50 does not match the movement of the second graphic 301A in the setting screen 315, which may cause confusion to the user. Therefore, even if the display position of the first graphic 51A is moved in the adjustment image 50, the second graphic 301A is not moved in the setting screen 315.

[0103] In addition, when the movement of the first graphic 51A in the adjustment image 50 is completed, the second control unit 250 deletes the third graphic 305 from the setting screen 315.

[0104] Figure 8 It is a flowchart showing the operation of the information processing apparatus 200.

[0105] Reference will be made to Figure 8 The operation of the information processing apparatus 200 will be described with reference to the flowchart shown.

[0106] When an operation of selecting the APP 265B is accepted through the input I / F 221, the second control unit 250 executes the APP 265B (step S1), and causes the display panel 235 to display the APP screen 300 (step S2).

[0107] When the APP screen 300 is displayed, the second control unit 250 determines whether the projection button 335 has been pressed to accept an instruction to project the adjustment image 50 (step S3). When the second control unit 250 has not accepted an instruction to project the adjustment image 50 (step S3: No), it stands by until an instruction to project is accepted.

[0108] When the second control unit 250 receives an instruction to project the adjustment image 50 (step S3: Yes), it generates adjustment image data and sends the generated adjustment image data to the projector 100 (step S4).

[0109] Next, the second control unit 250 determines whether an operation of selecting any one of the second graphics 301 has been received (step S5). When the second control unit 250 has not received an operation of selecting any one of the second graphics 301 (step S5: No), it stands by until an operation of selecting any one of the second graphics 301 is received.

[0110] When the second control unit 250 receives an operation of selecting any one of the second graphics 301 (step S5: Yes), it causes a rectangular graphic 303 surrounding the selected second graphic 301 to be displayed on the setting screen 315 (step S6).

[0111] Next, the second control unit 250 determines whether a movement operation specifying the movement destination of the selected second graphic 301 has been received (step S7). When the second control unit 250 has not received a movement operation (step S7: No), it stands by until a movement operation is received.

[0112] When the second control unit 250 receives a movement operation (step S7: Yes), it displays the third graphic 305 at the position on the setting screen 315 specified by the movement operation (step S8). Next, the second control unit 250 calculates the movement direction and the movement amount when moving from the position of the selected second graphic 301 to the position of the third graphic 305 (step S9).

[0113] Next, the second control unit 250 converts the calculated movement direction and movement amount into the movement direction and movement amount in the transmissive liquid crystal panel (step S10).

[0114] Next, the second control unit 250 causes the calculated movement amount to be displayed on the coordinate display 380 in the second area 340 (step S11).

[0115] Next, the second control unit 250 sequentially generates adjustment image data that moves the display position of the first graphic 51 corresponding to the selected second graphic 301 by the set amount in the movement direction (step S12). The second control unit 250 sends the generated adjustment image data to the projector 100 (step S13). That is, the second control unit 250 sends an instruction to project the moved first graphic 51 to the projector 100. During this period, the second control unit 250 does not change the display position of the selected second graphic 301 on the setting screen 315.

[0116] Next, the second control unit 250 determines whether the first graphic 51 has moved to the position specified by the moving operation (step S14). If it has not moved to the position specified by the moving operation (step S14: No), the second control unit 250 causes a return to step S12 to generate adjusted image data.

[0117] In addition, when the first graphic 51 moves to the position specified by the moving operation (step S14: Yes), the second control unit 250 deletes the third graphic 305 from the setting screen 315 (step S15).

[0118] Next, the second control unit 250 determines whether an operation of selecting any one of the second graphics 301 has been accepted (step S16). When the second control unit 250 has accepted an operation of selecting any one of the second graphics 301 (step S16: Yes), it returns to step S6 and displays a rectangular graphic 303 around the selected second graphic 301 on the setting screen 315.

[0119] In addition, when the second control unit 250 has not selected one of the second graphics 301 (step S16: No), it determines whether an operation to end the APP 265B has been accepted (step S17). When the second control unit 250 has not accepted an operation to end the APP 265B (step S17: No), it returns to the determination in step S15. When the second control unit 250 has accepted an operation to end the APP 265B (step S17: Yes), it ends this processing flow.

[0120] Figure 9 FIG. is a diagram showing a first display example of the setting screen 315.

[0121] In this first display example, during the movement of the first graphic 51 on the adjusted image 50, a plurality of arrow images 307 and the second graphic 301 are combined to display the moving direction of the first graphic 51. The plurality of arrow images 307 includes arrow images 307A, 307B, 307C, and 307D corresponding to the respective up, down, left, and right directions. The arrow images 307A, 307B, 307C, and 307D correspond to a plurality of arrow images that are one-to-one corresponding to the plurality of moving directions of the first graphic 51. In Figure 9 the example shown, in the drawing view, the moving direction from the second graphic 301 to the third graphic 305 is lower right, so an example is shown in which the arrow image 307D indicating the right direction and the arrow image 307B indicating the lower direction are displayed. The plurality of arrow images 307 is an example of movement display. In addition, the plurality of arrow images 307 is an example of direction display.

[0122] Figure 10 FIG. is a diagram showing a second display example of the setting screen 315.

[0123] In Display Example 2, when any one of the second graphics 301 is selected and a rectangular graphic 303 surrounding the selected second graphic 301 is displayed, a range image 309 indicating the range in which the third graphic 305 can be set is displayed. By displaying the range image 309, the user can identify the range in which the third graphic 305 can be set, and the user can efficiently set the third graphic 305.

[0124] Figure 11 It is a diagram showing Display Example 3 of the setting screen 315.

[0125] In Display Example 3, when any one of the second graphics 301 is selected and a rectangular graphic 303 surrounding the selected second graphic 301 is displayed, a magnified image 320 of a specified range including the selected second graphic 301 is generated and superimposed on the setting screen 315 for display.

[0126] In the magnified image 320, a magnified second graphic 321A, a magnified third graphic 325, a magnified rectangular graphic 323, and a magnified range image 329 are displayed. The display sizes of the magnified second graphic 321A, the magnified third graphic 325, the magnified rectangular graphic 323, and the magnified range image 329 displayed in the magnified image 320 are larger than the display sizes of the second graphic 301A, the third graphic 305, the rectangular graphic 303, and the range image 309 displayed on the setting screen 315. Therefore, the operability when the user operates the setting screen 315 can be improved.

[0127] Figure 12 and Figure 13 It is a diagram showing Display Example 4 of the setting screen 315.

[0128] Figure 12 It shows the setting screen 315 displayed when operations of a plurality of cursor keys included in the keyboard 225 as the second operation device are received. In addition, Figure 13 It shows the setting screen 315 displayed when a drag operation of the mouse 223 as the first operation device is received.

[0129] In the setting screen 315 displayed when operations of the cursor keys of the keyboard 225 are received, an arrow image 307 is displayed as a direction display indicating the moving direction of the first graphic 51. In Figure 12 An example is shown in which an arrow image 307A indicating that the moving direction is the right direction in the drawing view is displayed. In addition, the movement amount of the first graphic 51 is displayed in the coordinate display 380 of the second area 340. The arrow image 307A is an example of a movement display. The arrow image 307A is an example of a direction display.

[0130] In addition, the third graphic 305 is displayed in the setting screen 315 that is displayed when the drag operation of the mouse 223 is accepted.

[0131] In this way, by changing the display of the setting screen 315 according to the operating device that has accepted the user's operation, the user can identify the operating device that the user is operating.

[0132] Figure 14 It is a diagram showing a display example 5 of the setting screen 315.

[0133] In display example 5, during the period when the display position of the first graphic 51 in the adjustment image 50 is moved, the fourth graphic 330 is displayed instead of the second graphic 301 corresponding to the first graphic 51. The fourth graphic 330 is a graphic that is different from the second graphic 301 in at least one of shape and color.

[0134] In Figure 4 an example is shown in which the oval fourth graphic 330 is displayed instead of the cross-shaped second graphic 301, but the shape of the fourth graphic 330 is not limited to an oval, as long as the shape is different from the second graphic 301. In addition, even if the shape of the fourth graphic 330 is the same as the shape of the second graphic 301, as long as the color of the fourth graphic 330 is different from the color of the second graphic 301. By displaying the fourth graphic 330 instead of the third graphic 305 in this way, the user can recognize that the position of the first graphic 51 in the adjustment image 50 has been changed.

[0135] 5. Other structures

[0136] The above-described embodiments are preferred embodiments of the present invention. However, it is not limited to the above-described manner, and various modifications can be made without departing from the gist of the present invention.

[0137] For example, in the above-described embodiment, a structure in which the display unit 230 included in the information processing device 200 is used as a display device has been described, but it is not limited thereto. For example, as the display device, a liquid crystal display, an organic EL display, a plasma display, or the like that is externally connected to the information processing device 200 can also be used.

[0138] In addition, in the above-described embodiment, as an example of the moving display, at least the coordinate display 380 is displayed, but it is not limited thereto. For example, the coordinate display 380 may not be displayed, and only the arrow image 307A as the direction display may be displayed.

[0139] In addition, in the above-described embodiment, the moving display is performed according to the user's operation on the second graphic 301 displayed on the display unit 230, but it is not limited thereto. For example, the moving display may also be performed according to the user's operation on the remote controller 105. Specifically, the remote controller 105 may receive an operation for moving the first graphic 51, the projector 100 may receive an operation signal corresponding to the operation from the remote controller 105, the projector 100 may move the first graphic 51A in the adjustment image 50 according to the operation signal, and the projector 100 may send at least one of the information indicating the moving amount of the first graphic 51A and the information indicating the moving direction to the information processing device 200. The information processing device 200 may cause the setting image 316 to display at least one of the coordinate display 380 based on the information indicating the moving amount of the first graphic 51A and the arrow image 307A based on the information indicating the moving direction.

[0140] In addition, in the above-described embodiment, the information processing device 200 generates adjustment image data and sends the generated adjustment image data to the projector 100. The projector 100 generates image light based on the adjustment image data received from the information processing device 200 and projects it onto the projection target 30. As another example, the projector 100 may also generate adjustment image data according to the instruction of the information processing device 200.

[0141] In addition, Figure 2 Each functional unit of the projector 100 shown represents a functional structure, and there is no particular limitation on the specific installation method. That is, it is not necessarily required to install hardware corresponding to each functional unit. Of course, it can also be configured to implement the functions of multiple functional units by executing a program with one processor. In addition, in the above-described embodiment, a part of the functions implemented by software can be implemented by hardware, and a part of the functions implemented by hardware can also be implemented by software. In addition, regarding the specific detailed structure of other parts of the projector, it can also be arbitrarily changed within the scope not departing from the gist of the present invention.

[0142] In addition, Figure 3 Each functional unit of the information processing device 200 shown represents a functional structure, and there is no particular limitation on the specific installation method. That is, it is not necessarily required to install hardware corresponding to each functional unit. Of course, it can also be configured to implement the functions of multiple functional units by executing a program with one processor. In addition, in the above-described embodiment, a part of the functions implemented by software can be implemented by hardware, and a part of the functions implemented by hardware can also be implemented by software. In addition, regarding the specific detailed structure of other parts of the information processing device, it can also be arbitrarily changed within the scope not departing from the gist of the present invention.

[0143] In addition, Figure 8The processing units of the flowchart shown are units divided according to the main processing contents for easy understanding of the processing of the information processing apparatus 200. The present invention is not limited to Figure 8 the method of dividing and the names of the processing units shown in the flowchart. In addition, the processing of the second control unit 250 can be divided into more processing units according to the processing contents, or can be divided into one processing unit including more processing. In addition, the processing order of the above flowchart is not limited to the illustrated example.

[0144] In addition, when implementing a program using the computer (processor) included in the information processing apparatus 200 and the computer (processor) included in the projector 100, it is also possible to configure a program that causes these computers to execute in a form of a non-transitory recording medium readable by the computer (processor). Alternatively, it is also possible to configure it in the form of a transmission medium that transmits a program that causes these computers to execute. As the recording medium, a magnetic, optical recording medium, or semiconductor storage device can be used. Specifically, removable or fixed recording media such as a floppy disk, HDD (Hard Disk Drive), CD-ROM, DVD (Digital Versatile Disc), Blu-ray Disc, magneto-optical disk, flash memory, and card-type recording media can be cited. In addition, the above recording medium can also be a non-volatile storage device such as a RAM, ROM, or HDD which is an internal storage device included in the server device. Blu-ray is a registered trademark.

[0145] 6. Summary of the present disclosure

[0146] Hereinafter, the summary of the present disclosure is noted.

[0147] Note 1

[0148] A display method in a projection system including a projection device and an information processing device, the display method including: projecting a first image including a first graphic from the projection device; displaying, by the information processing device, a second image including a second graphic corresponding to the first graphic on a display device different from the projection device; when a movement operation for moving the position of the first graphic is received by the information processing device, associating, by the information processing device, a movement display indicating that the first graphic moves in the first image with the second graphic and displaying the movement display on the second image; and projecting the moved first graphic from the projection device.

[0149] Accordingly, when a movement operation for moving the position of the first graphic is received, a movement display indicating that the first graphic moves in the first image is displayed on the second image by the information processing device in association with the second graphic. Thus, the user can grasp the situation that the first graphic of the first image projected by the projection device is moving through the second image displayed on the display device.

[0150] Supplementary Note 2

[0151] According to the display method described in Supplementary Note 1, wherein the position of the second graphic when the position of the first graphic is the first position is the same as the position of the second graphic when the position of the first graphic is a second position different from the first position.

[0152] Accordingly, even if the position of the first graphic in the first image changes from the first position to the second position, the position of the second graphic in the second image does not change. When the movement of the first graphic in the first image is linked to the movement of the second graphic in the second image, depending on the projection object on which the projection device projects the first image, sometimes there is a deviation between the movement of the first graphic in the first image and the movement of the second graphic in the second image, which gives the user a sense of discomfort. Therefore, by not changing the position of the second graphic in the second image even if the position of the first graphic in the first image is changed, it does not give the user a sense of discomfort.

[0153] Supplementary Note 3

[0154] According to the display method described in Supplementary Note 1 or 2, wherein the movement display includes at least one of a direction display indicating the movement direction of the first graphic and a movement amount display indicating the movement amount of the first graphic.

[0155] Accordingly, the situation that the first graphic is moving is displayed by a direction display indicating the movement direction of the first graphic and a movement amount display indicating the movement amount of the first graphic. Thus, even when it is difficult for the user to visually confirm the first graphic of the first image projected by the projection device, the user can grasp the situation that the first graphic is moving through the movement operation.

[0156] Supplementary Note 4

[0157] The display method according to Note 2 or 3, wherein the moving operation includes an operation of specifying the moved position of the first graphic in the second image, and the information processing device displaying the second image includes: the information processing device displaying a third graphic at the position on the second image specified by the specified operation; the projection device moving the position of the first graphic on the first image includes: the projection device moving the first graphic to the position on the first image corresponding to the position of the third graphic on the second image; the information processing device displaying the second image further includes: after the movement of the first graphic ends, the information processing device deleting the third graphic from the second image.

[0158] Thus, by operating to specify the moved position of the first graphic in the second image, the third graphic can be displayed at the specified position on the second image, and the first graphic can be moved to the position on the first image corresponding to the position of the third graphic on the second image. Therefore, the position of the first graphic in the first image can be changed by an intuitive operation. In addition, after the movement of the first graphic ends, the third graphic is deleted from the second image, so that the graphic unnecessary for the operation can be deleted.

[0159] Note 5

[0160] The display method according to Note 4, wherein the third graphic is congruent or similar to the second graphic.

[0161] Thus, the appearance design of the third graphic is the same as that of the second graphic, and the second graphic that does not move in the second image can be made to appear as if it is moving virtually, which can improve the operability.

[0162] Note 6

[0163] The display method according to Note 4 or 5, wherein the moving display is a plurality of arrow images that are in one-to-one correspondence with a plurality of moving directions of the first graphic, and the information processing device displaying the second image further includes: the information processing device combining at least one of the plurality of arrow images with the third graphic to display the moving direction of the third graphic.

[0164] Thus, the moving direction of the third graphic is displayed by combining at least one of the plurality of arrow images with the third graphic. Therefore, the user can grasp the moving direction of the third graphic.

[0165] Note 7

[0166] The display method according to any one of Appendices 4 to 6, wherein displaying the second image by the information processing device includes: displaying, by the information processing device, a range image representing a movable range of the third graphic.

[0167] Thereby, a range image representing the range within which the third graphic can move is displayed as the second image. Thus, the user can grasp the range within which the third graphic can be moved.

[0168] Appendix 8

[0169] The display method according to Appendix 7, wherein the display method further includes: overlapping, by the information processing device, a third image including the second graphic, the third graphic, and the range image on the second image, and the display sizes of the second graphic, the third graphic, and the range image in the third image are larger than the display sizes of the second graphic, the third graphic, and the range image in the second image.

[0170] Thereby, the third image including the second graphic, the third graphic, and the range image is displayed overlapping the second image. Since the display sizes of the second graphic, the third graphic, and the range image in the third image are larger than the display sizes of the second graphic, the third graphic, and the range image in the second image, the operability of the user can be improved.

[0171] Appendix 9

[0172] The display method according to any one of Appendices 4 to 8, wherein displaying the second image includes: when an operation is received by the first operation device, displaying, by the information processing device, the third graphic; and when an operation is received by a second operation device different from the first operation device, displaying, by the information processing device, a direction display representing the moving direction of the first graphic.

[0173] Thereby, the display of the second image is different when an operation is performed by the first operation device and when an operation is performed by the second operation device. Thus, the operation device being operated by the user can be identified.

[0174] Appendix 10

[0175] The display method according to Appendix 9, wherein the first operation device receives an operation in a first mode from the user, and the second operation device receives an operation in a second mode different from the operation in the first mode from the user.

[0176] Accordingly, the first operation device receives an operation of the first method from the user, and the second operation device receives an operation of the second method different from the operation of the first method from the user. Therefore, by changing the operation device, the second figure displayed in the second image can be operated in different operation methods.

[0177] Supplementary Note 11

[0178] According to the display method described in Supplementary Note 9 or 10, wherein the first operation device is a mouse, the second operation device is a plurality of cursor keys included in a keyboard, the third figure is moved by a drag operation of the mouse, and the direction display corresponds to the direction indicated by the cursor keys.

[0179] Accordingly, the third figure can be moved by performing a drag operation on the mouse, and the direction display can be displayed in a direction corresponding to the operation received by the cursor keys of the keyboard.

[0180] Supplementary Note 12

[0181] According to the display method described in any one of Supplementary Notes 3 to 11, wherein the second image includes: a first area that receives the movement operation and displays the direction display and the second figure; and a second area that displays the movement amount display.

[0182] Accordingly, the second image including the first area that receives the movement operation and displays the direction display and the second figure and the second area that displays the movement amount display is displayed. The user can recognize the moving direction and the moving amount of the second figure.

[0183] Supplementary Note 13

[0184] According to the display method described in any one of Supplementary Notes 1 to 8, wherein displaying the second image includes: during the period of moving the position of the first figure on the first image, the information processing device displays a fourth figure having at least one of a shape and a color different from that of the second figure instead of the second figure.

[0185] Accordingly, during the period of moving the position of the first figure, a fourth figure having at least one of a shape and a color different from that of the second figure is displayed instead of the second figure. Therefore, the user can grasp that the position of the first figure is being moved.

[0186] Supplementary Note 14

[0187] An information processing apparatus includes one or more processors that control a display device, and the one or more processors perform the following processes: displaying a second image including a second graphic on the display device, the second graphic corresponding to a first graphic included in a first image projected from a projection device; when a movement operation for moving the position of the first graphic is received, displaying, on the second image, a movement display indicating the movement of the first graphic in the first image in association with the second graphic selected by the movement operation; and sending a projection instruction for the moved first graphic to the projection device.

[0188] Thus, when a movement operation for moving the position of the first graphic is received, the information processing apparatus displays, on the second image, a movement display indicating the movement of the first graphic in the first image in association with the second graphic. Therefore, the user can grasp the movement of the first graphic of the first image projected by the projection device through the second image displayed on the display device.

[0189] Appendix 15

[0190] A program causes a processor of an information processing apparatus that controls a display device to perform the following processes: displaying a second image including a second graphic on the display device, the second graphic corresponding to a first graphic included in a first image projected from a projection device; when a movement operation for moving the position of the first graphic is received, displaying, on the second image, a movement display indicating the movement of the first graphic on the first image in association with the second graphic; and sending a projection instruction for the moved first graphic to the projection device.

[0191] Thus, when a movement operation for moving the position of the first graphic is received, the information processing apparatus displays, on the second image, a movement display indicating the movement of the first graphic in the first image in association with the second graphic. Therefore, the user can grasp the movement of the first graphic of the first image projected by the projection device through the second image displayed on the display device.

Claims

1. A display method in a projection system, the projection system including a projection device and an information processing device, wherein, The display method includes: Projecting a first image including a first graphic from the projection device; Displaying a second image including a second graphic corresponding to the first graphic on a display device different from the projection device by the information processing device; When a movement operation for moving the position of the first graphic is received by the information processing device, associating a movement display indicating the movement of the first graphic in the first image with the second graphic and displaying the movement display on the second image by the information processing device; and Projecting the moved first graphic from the projection device.

2. The display method according to claim 1, wherein the position of the second graphic when the position of the first graphic is a first position is the same as the position of the second graphic when the position of the first graphic is a second position different from the first position.

3. The display method according to claim 1, wherein the movement display includes at least one of a direction display indicating the movement direction of the first graphic and a movement amount display indicating the movement amount of the first graphic.

4. The display method according to claim 2, wherein the movement operation includes an operation of specifying the moved position of the first graphic in the second image, displaying the second image by the information processing device includes: displaying a third graphic at a position on the second image specified by the specified operation by the information processing device, moving the position of the first graphic on the first image by the projection device includes: moving the first graphic by the projection device to a position on the first image corresponding to the position of the third graphic on the second image, displaying the second image by the information processing device further includes: after the movement of the first graphic ends, deleting the third graphic from the second image by the information processing device.

5. The display method according to claim 4, wherein the third graphic is congruent or similar to the second graphic.

6. The display method according to claim 4, wherein the movement display is a plurality of arrow images that are in one-to-one correspondence with a plurality of movement directions of the first graphic, displaying the second image by the information processing device further includes: combining at least one of the plurality of arrow images with the third graphic and displaying the movement direction of the third graphic by the information processing device.

7. The display method according to claim 4, wherein displaying the second image by the information processing device includes: displaying a range image indicating the movable range of the third graphic by the information processing device.

8. The display method according to claim 7, wherein the display method further includes: overlapping and displaying a third image including the second graphic, the third graphic, and the range image on the second image by the information processing device, the display sizes of the second graphic, the third graphic, and the range image in the third image are larger than the display sizes of the second graphic, the third graphic, and the range image in the second image.

9. The display method according to claim 4, wherein displaying the second image includes: when an operation is received by the first operation device, displaying the third graphic by the information processing device; and when an operation is received by a second operation device different from the first operation device, displaying a direction display indicating a moving direction of the first graphic by the information processing device.

10. The display method according to claim 9, wherein the first operation device receives an operation in a first mode from a user, the second operation device receives an operation in a second mode different from the operation in the first mode from the user.

11. The display method according to claim 9, wherein the first operation device is a mouse, the second operation device is a plurality of cursor keys included in a keyboard, the third graphic is moved by a drag operation on the mouse, the direction display corresponds to the direction indicated by the cursor keys.

12. The display method according to claim 3, wherein the second image includes: a first area that receives the moving operation and displays the direction display and the second graphic; and a second area that displays the movement amount display.

13. The display method according to any one of claims 1 to 8, wherein displaying the second image includes: during a period of moving the position of the first graphic on the first image, displaying a fourth graphic whose at least one of a shape and a color is different from the second graphic by the information processing device to replace the second graphic.

14. An information processing device including one or more processors that control a display device, the one or more processors perform the following processing: displaying a second image including a second graphic corresponding to a first graphic included in a first image projected from a projection device on the display device; when a moving operation for moving the position of the first graphic is received, associating and displaying a movement display indicating that the first graphic moves in the first image with the second graphic corresponding to the first graphic selected by the moving operation on the second image; and sending a projection instruction for the moved first graphic to the projection device.

15. A program product that causes a processor of an information processing device controlling a display device to perform the following processing: displaying a second image including a second graphic corresponding to a first graphic included in a first image projected from a projection device on the display device; when a moving operation for moving the position of the first graphic is received, associating and displaying a movement display indicating that the first graphic moves on the first image with the second graphic on the second image; and sending a projection instruction for the moved first graphic to the projection device.

Images