Image data saving method

Abstract

To make it easy to save the image data of the image displayed on the screen. [Solution] An image data storage method comprising: an information processing device communicating with a display device that displays an image on a display surface receiving an operation to select first folder information; the display device displaying a first icon for saving the image displayed on the display surface; the display device receiving an operation to select the first icon to display; and the information processing device saving image data of the image displayed on the display surface in a folder named based on second folder information and the first folder information.

Description

Technical Field

[0001] The present invention relates to a method for storing image data.

Background Art

[0002] Conventionally, a display device that accepts operations on an image displayed on a display surface is known. For example, Patent Document 1 discloses a projector that projects a screen keyboard image on a projection surface and accepts operations on the projected screen keyboard image.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when storing the image data of an image displayed on a display surface, setting the storage destination using an image such as the screen keyboard image described in Patent Document 1 may complicate the user's operation.

Means for Solving the Problems

[0005] The image data storage method of the present disclosure includes: an information processing device communicatively connected to a display device that displays an image on a display surface accepting an operation of selecting first folder information; the display device displaying a first icon for storing the image displayed on the display surface; the display device accepting an operation of selecting the displayed first icon; and the information processing device storing the image data of the image displayed on the display surface in a folder having a folder name based on second folder information and the first folder information.

Brief Description of the Drawings

[0006] [Figure 1] A diagram showing the system configuration of the projection system. [Figure 2] A side view showing the installation configuration of the projector. [Figure 3] A block diagram showing the configuration of the projector. [Figure 4] A diagram showing an example of the first icon. [Figure 5] A block diagram showing the configuration of an information processing device. [Figure 6] An example image showing how to set folder names. [Figure 7A] A diagram to explain the list of images. [Figure 7B] A diagram to explain the list of images. [Figure 8] A diagram showing an example of an edited image. [Figure 9A] A diagram illustrating the saving of captured image data. [Figure 9B] A diagram illustrating the saving of captured image data. [Figure 9C] A diagram illustrating the saving of captured image data. [Figure 10] An example image showing how to set folder names. [Figure 11] A flowchart illustrating the operation of an information processing device. [Figure 12] A flowchart illustrating the operation of a projector. [Figure 13] A flowchart illustrating the operation of a projector and an information processing device. [Figure 14] A flowchart illustrating the operation of a projector and an information processing device. [Figure 15] A flowchart illustrating the operation of a projector and an information processing device. [Modes for carrying out the invention]

[0007] [1. First Embodiment] The first embodiment will be described below with reference to the attached drawings.

[0008] [1-1. System Configuration] FIG. 1 is a diagram showing the system configuration of the projection system 1. FIG. 2 is a side view showing the installation state of the projector 2. The projection system 1 is a system including a projector 2 and an information processing apparatus 3. The projector 2 is an example of a "display device".

[0009] The projector 2 generates image light and projects the generated image light onto the projection surface 4 to display an image on the projection surface 4. Hereinafter, the normal line of the projection surface 4 is defined as the Z-axis, the vertical axis as the Y-axis, and the axis perpendicular to the Z-axis and the Y-axis as the X-axis for explanation. The Z-axis corresponds to the front-rear direction in the installation state of the projector 2. The positive direction of the Z-axis indicates the front. The Y-axis corresponds to the up-down direction. The positive direction of the Y-axis indicates the up. The X-axis corresponds to the left-right direction. The positive direction of the X-axis indicates the right. The projection surface 4 is an example of a "display surface".

[0010] The projector 2 is installed in front of and above the projection surface 4 and emits image light toward the projection surface 4. Hereinafter, the area of the projection surface 4 where the image light is emitted is referred to as a projection area 5. An image is displayed in the projection area 5 by the image light emitted from the projector 2.

[0011] Note that the projection surface 4 may be a screen, or may be a wall surface of a building or a flat surface of an installation object. Further, the projection surface 4 is not limited to a flat surface, and may be a curved surface or a surface having irregularities.

[0012] The projector 2 has an interactive function. The interactive function is a function of detecting the position of the projection surface 4 specified by the indicator 6 and displaying an image corresponding to the position or trajectory of the indicator 6 on the projection surface 4 based on the detected position, or executing processing corresponding to the detected position. In the present embodiment, a finger of a hand is exemplified as the indicator 6.

[0013] Projector 2 emits detection light LT in the direction corresponding to the projection surface 4. Therefore, when the tip of the indicator 6 comes into contact with the projection surface 4, the indicator 6 blocks the detection light LT. The detection light LT hits the indicator 6 and is reflected, and a portion of the reflected light of the detection light LT travels from the indicator 6 towards Projector 2. Projector 2 detects the reflected light of the detection light LT reflected by the indicator 6 and detects the position indicated by the indicator 6. Projector 2 emits detection light LT in the direction corresponding to the projection surface 4. Specifically, the direction corresponding to the projection surface 4 is the direction in which the reflected light reflected by the indicator 6 within range HA can be incident on the infrared camera 25. Range HA is a range in the front-to-back direction, where the distance from the projection surface 4 to the front is less than or equal to a threshold. The detection light LT is emitted in a range that includes at least a part of the projection surface 4. In this embodiment, the detection light LT is emitted in a range that covers at least the entire projection area 5. The detection light LT is the light used to detect the indicator 6, and in this embodiment, infrared light is used.

[0014] The information processing device 3 supplies images to the projector 2, which is connected via communication, and saves image data of the image displayed on the projection surface 4. Hereinafter, the image data of the image displayed on the projection surface 4 will be referred to as "captured image data." Figure 1 shows the case where the information processing device 3 is a laptop PC (Personal Computer), but the information processing device 3 may also be a desktop PC, a tablet device, a smartphone, etc. Also, Figure 1 shows the case where the information processing device 3 and the projector 2 are connected wirelessly, but the information processing device 3 and the projector 2 may also be connected by a wired connection.

[0015] [1-2. Configuration of Projector and Information Processing Device] Next, the configuration of Projector 2 will be explained with reference to Figure 2. Figure 2 is a block diagram showing the configuration of Projector 2.

[0016] Projector 2 comprises a first communication interface 20, an image processing unit 21, a frame memory 22, a projection unit 23, an ejection unit 24, an infrared camera 25, and a first control unit 26. Hereinafter, the interface will be abbreviated as I / F.

[0017] The first communication interface 20 includes a connector and interface circuit conforming to a predetermined communication standard. The first communication interface 20 communicates with the information processing device 3 in accordance with the control of the first control unit 26.

[0018] The image processing unit 21 and the frame memory 22 are composed of, for example, integrated circuits. Integrated circuits include LSIs (Large Scale Integration), ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), FPGAs (Field-Programmable Gate Arrays), SoCs (System-on-a-chip), etc. Furthermore, the configuration of the integrated circuit may include analog circuits as part of its configuration, and the first control unit 26 may be combined with an integrated circuit.

[0019] The image processing unit 21 is connected to a frame memory 22. The frame memory 22 has multiple banks. Each bank has a storage capacity that can write one frame's worth of display image. The frame memory 22 is composed of, for example, SDRAM (Synchronous Dynamic RAM). The image processing unit 21 loads the image input from the first communication interface 20 into the frame memory 22.

[0020] The image processing unit 21 comprises a first image processing unit 211 and a second image processing unit 212. The first image processing unit 211 performs image processing on the image expanded in the frame memory 22. The image processing performed by the first image processing unit 211 includes, for example, resolution conversion or resizing, distortion correction, shape correction, digital zoom, and adjustment of image hue and brightness. The first image processing unit 211 executes the processing specified by the first control unit 26 and, if necessary, uses parameters input from the first control unit 26. The first image processing unit 211 can also, of course, combine and execute multiple of the above image processing operations.

[0021] The second image processing unit 212 performs drawing processing on the image data processed by the first image processing unit 211. The second image processing unit 212 performs drawing processing corresponding to the position of the indicator 6 on the projection surface 4 detected by the first control unit 26. The position of the indicator 6 detected by the first control unit 26 indicates the coordinates of the position of the reflected light in the captured image generated by the infrared camera 25, which will be described later. The second image processing unit 212 converts these coordinates into coordinates for the frame memory 22, and superimposes the image data of the third image G3 drawn by the indicator 6 onto the position in the frame memory 22 indicated by the converted coordinates.

[0022] The projection unit 23 includes a light source 231, a light modulator 232, and an optical unit 233.

[0023] The light source 231 includes a discharge-type light source lamp such as an ultra-high pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light-emitting diode or a semiconductor laser. The light emitted from the light source 231 is incident on the light modulation device 232.

[0024] The optical modulator 232 includes a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates, serving as an optical modulator element for modulating the light emitted from the light source 231. The liquid crystal panel is not shown in the diagram. The liquid crystal panel comprises a panel area consisting of multiple pixels arranged in a matrix. The optical modulator 232 applies a drive voltage corresponding to the image input from the image processing unit 21 to each pixel in the panel area, changing the light transmittance of each pixel to the transmittance corresponding to the displayed image. The light emitted from the light source 231 is modulated as it passes through the liquid crystal panel, generating image light corresponding to the projected image.

[0025] The optical modulation element of the optical modulation device 232 is not limited to a transmissive liquid crystal panel; for example, it may be a reflective liquid crystal panel or a DMD (Digital Micromirror Device).

[0026] The optical unit 233 includes a projection lens (not shown) and emits image light modulated by the optical modulator 232.

[0027] The emission unit 24 emits detection light LT for detecting the indicator 6 into the area including the projection surface 4. In Figure 3, the detection light LT is shown by a dashed line. The emission unit 24 is equipped with an LD (Laser Diode) or an LED as a light source that emits infrared light. The emission unit 24 may also be equipped with an optical component that diffuses the infrared light emitted by the light source toward the projection surface 4.

[0028] The infrared camera 25 is equipped with an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) or CCD (Charge Coupled Device) that receives the detection light LT emitted by the indicator 6. The infrared camera 25 also includes an optical system that forms an image on the image sensor, and an aperture that limits the light incident on the image sensor. The infrared camera 25 captures an image of the area including the projection surface 4 and generates an image. The infrared camera 25 captures an image by receiving the detection light LT emitted by the indicator 6. The image data of the image generated by the infrared camera 25 is output to the first control unit 26.

[0029] The first control unit 26 is a computer device that includes a first processor 200 such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), and a first memory 220.

[0030] The first memory 220 is a storage device that stores programs and data. The first memory 220 stores the first control program 221 and data processed by the first processor 200. The first memory 220 has a non-volatile storage area. The first memory 220 also has a volatile storage area and constitutes the work area of ​​the first processor 200. The first memory 220 is composed of, for example, ROM (Read Only Memory) and RAM (Random Access Memory).

[0031] The first control unit 26 communicates with the information processing device 3 via the first communication interface 20 by having the first processor 200 execute the first control program 221 stored in the first memory 220.

[0032] The first control unit 26 detects the position of the indicator 6 on the projection surface 4 by having the first processor 200 execute the first control program 221 stored in the first memory 220. The first control unit 26 acquires an image from the infrared camera 25 and detects the coordinates of the position of the reflected light in the acquired image as the position of the indicator 6.

[0033] The first control unit 26 displays an image on the projection surface 4 by having the first processor 200 execute the first control program 221 stored in the first memory 220, causing the image processing unit 21 and projection unit 23 to emit image light onto the projection surface 4. Specifically, the first control unit 26 causes the first image processing unit 211 to expand the image data supplied from the information processing device 3 into the frame memory 22 and to process the image data expanded into the frame memory 22. The first control unit 26 also causes the second image processing unit 212 to perform drawing processing based on the position of the detected indicator 6. Furthermore, the first control unit 26 turns on the light source 231, drives the light modulator 232, and has the projection unit 23 emit image light to display an image on the projection surface 4. The first control unit 26 also controls the optical unit 233 to adjust the zoom and focus of the optical unit 233.

[0034] In this embodiment, the first control unit 26 displays the first icon IC1 on the projection surface 4 when the projector 2 and the information processing device 3 are connected via communication. The first control unit 26 displays the first icon IC1 on the projection surface 4 by expanding the image data of the first icon IC1 in the frame memory 22.

[0035] Figure 4 shows an example of the first icon IC1. Figure 4 illustrates a case where the information processing device 3 and the projector 2 are sharing a screen. In other words, Figure 4 illustrates a case where the projector 2 displays the image displayed by the information processing device 3 on the projection surface 4.

[0036] In the example shown in Figure 4, the image displayed by the information processing device 3 includes a second image G2 and a first image G1 superimposed on the second image G2. The first image G1 is an image displayed by an application program 312 stored in the information processing device 3. Details of the application program 312 and the first image G1 will be described later. Hereafter, the application program 312 will be referred to as APP312. The second image G2 is a different image from the first image G1 and is an image displayed by a program other than APP312. In Figure 4, the second image G2 is an image showing the letter "A".

[0037] In addition, in the example shown in Figure 4, the image displayed by projection surface 4 includes the third image G3. In Figure 4, the third image G3 is displayed superimposed on the second image G2.

[0038] The first icon IC1 is an icon that saves the image displayed by the projection surface 4. In other words, the first icon IC1 is an icon that captures the image displayed by the projection surface 4. Note that the display position of the first icon IC1 is not limited to the position shown in Figure 4, and may be, for example, in the lower right corner, but from the perspective of human operation, it is preferable that it be located below the center of the projection surface 4 in the vertical direction.

[0039] The first control unit 26 receives an operation to select the first icon IC1 when the first processor 200 executes the first control program 221 stored in the first memory 220. Specifically, when the first icon IC1 is displayed, the first control unit 26 receives an operation to select the first icon IC1 if the position of the detected indicator 6 corresponds to the display position of the first icon IC1.

[0040] Next, with reference to Figure 5, the configuration of the information processing device 3 will be described. Figure 5 is a block diagram showing the configuration of the information processing device 3.

[0041] The information processing device 3 comprises a second communication interface 30, a display unit 31, an operation unit 32, and a second control unit 33.

[0042] The second communication interface 30 includes a connector and interface circuit conforming to a predetermined communication standard. The second communication interface 30 communicates with the projector 2 according to the control of the second control unit 33.

[0043] The display unit 31 includes a display such as a liquid crystal display or an organic EL (Electro Luminescence) display.

[0044] The operation unit 32 is equipped with input devices such as a mouse or keyboard and accepts user input. The operation unit 32 outputs an operation signal corresponding to the received operation to the second control unit 33.

[0045] The second control unit 33 is a computer device that includes a second processor 300 such as a CPU or MPU, and a second memory 310.

[0046] The second memory 310 is a storage device that stores programs and data. The second memory 310 stores the second control program 311, APP 312, history information 313, and data processed by the second processor 300. The second memory 310 has a non-volatile storage area. The second memory 310 also has a volatile storage area and constitutes the work area of ​​the second processor 300. The second memory 310 is composed of, for example, ROM or RAM.

[0047] The second control unit 33 causes the second processor 300 to execute the second control program 311 stored in the second memory 310, thereby displaying the second image G2 on the display unit 31.

[0048] The second control unit 33 communicates with the projector 2 via the second communication interface 30 by having the second processor 300 execute APP 312 stored in the second memory 310.

[0049] Furthermore, the second control unit 33 causes the second processor 300 to execute APP 312 stored in the second memory 310, thereby displaying the first image G1 on the display unit 31. The second control unit 33 displays the first image G1 superimposed on the second image G2.

[0050] Furthermore, the second control unit 33 receives an operation on the first image G1 via the operation unit 32 when the second processor 300 executes APP 312 stored in the second memory 310.

[0051] Now, let's explain the first image, G1. Image 1G1 is an image related to saving the image displayed on projection surface 4. Image 1G1 includes folder name setting image G11. Folder name setting image G11 is Image 1G1 related to setting the folder name for saving the captured image data.

[0052] Figure 6 shows an example of folder name setting image G11. As shown in Figure 6, the folder name setting image G11 has a folder name setting area A1. The folder name setting area A1 has date information J1 and a folder information display area A2. Date information J1 is an example of "Second Folder Information".

[0053] Date information J1 indicates the date when the first image G1 is being displayed. Folder information display area A2 is the area that displays the first folder information J2.

[0054] The folder information display area A2 will be described in detail below, but before that, the first folder information J2 and the history information 313 will be explained. The first folder information J2 is the information that constitutes the folder name where the captured image data is saved. History information 313 is information that shows the history of the first folder information J2 used as the folder name for saving captured image data. History information 313 includes the first folder information J2 that was displayed in the folder information display area A2 and used as the folder name for saving captured image data. Note that history information 313 is stored in the local folder of the information processing device 3.

[0055] If the history information 313 includes the first folder information J2 and an operation to select the folder information display area A2 is received, the second control unit 33 displays the list image G4 in the folder name setting image G11. The operation to select the folder information display area A2 is, for example, an operation performed by clicking with the mouse while the cursor is over the folder information display area A2.

[0056] Figures 7A and 7B are diagrams illustrating the list image G4. Figure 7A shows the folder name setting image G11 for displaying the list image G4. List image G4 is a screen that displays a list of the first folder information J2 included in the history information 313. In the example in Figure 7A, the strings "1-1", "1-2", "FLD1", and "FLD2" are each the first folder information J2. List image G4 displays each of the first folder information J2 as selectable.

[0057] When the selection operation for the first folder information J2 is received in the list image G4, the second control unit 33 hides the list image G4 and displays the first folder information J2 selected in the list image G4 in the folder information display area A2. As a result, the first folder information J2 selected from the list image G4 is input into the folder information display area A2. Figure 7A shows the case where the first folder information J2 of "1-1" is selected in the list image G4, and Figure 7B shows the case where the selected first folder information J2 of "1-1" is input into the folder information display area A2.

[0058] Furthermore, the first folder information J2 displayed in the list image G4 can be added using the edit image G12. In other words, new first folder information J2 can be added to the history information 313.

[0059] Figure 8 shows an example of edited image G12. Edited image G12 is an image related to the editing of the first folder information J2 included in the history information 313. The second control unit 33 receives an operation on the first button B1 displayed by the folder name setting image G11, and displays the edited image G12 on the display unit 31. The first button B1 is a software button.

[0060] Edited image G12 displays a list of first folder information J2 included in history information 313. In edited image G12, each of the first folder information J2 is displayed as selectable. If one first folder information J2 is selected in edited image G12 and then deleted, the selected first folder information J2 is deleted from history information 313. Also, if one first folder information J2 is selected in edited image G12 and then modified, the selected first folder information J2 is updated in history information 313 to reflect the modified first folder information J2.

[0061] Edited image G12 displays the second button B2. The second button B2 is a software button for adding the first folder information J2. If the first folder information J2 is added using the second button B2 in edited image G12, the history information 313 will contain the new first folder information J2.

[0062] Returning to the explanation of Figure 6, the folder name setting image G11 displays the third button B3. The third button B3 is a software button for opening a folder whose name is composed of the date information J1 and the first folder information J2 displayed in the folder information display area A2. If a folder whose name is composed of the date information J1 and the first folder information J2 displayed in the folder information display area A2 has not been created, the third button B3 will be grayed out and will be inoperable.

[0063] Returning to the description of the second control unit 33, the second control unit 33 saves the captured image data by having the second processor 300 execute APP 312, which is stored in the second memory 310.

[0064] More specifically, when the folder information display area A2 displays the first folder information J2, the second control unit 33 saves the captured image data when the first icon IC1 is operated. If a folder with the name specified in folder name setting area A1 does not exist in the storage folder FD which stores the destination folder for saving captured image data, the second control unit 33 creates a folder with the name specified in folder name setting area A1 in the storage folder FD. Then, the second control unit 33 saves the captured image data to the created folder as the destination folder. On the other hand, if a folder with the folder name indicated by the folder name setting area A1 has been created in the storage folder FD, the second control unit 33 saves the captured image data to that created folder as the save destination folder.

[0065] The storage folder FD and the folders created within the storage folder FD are local folders of the information processing device 3. The link to the storage folder FD is stored in the second memory 310. The second control unit 33 reads the link to the storage folder FD from the second memory 310 and creates folders and saves captured image data based on the read link.

[0066] Figures 9A, 9B, and 9C illustrate the storage of captured image data. Figures 9A, 9B, and 9C illustrate the procedure by which the captured image data is saved when the first icon IC1 is operated, provided that the date information J1 in the folder name setting area A1 is "20250303" and the first folder information J2 in the folder information display area A2 is "1-4".

[0067] In the example in Figure 9A, the folder named "20250303 1-4", which is composed of "20250303" and "1-4", has not been created on the storage folder FD. Therefore, as shown in Figure 9B, the second control unit 33 creates the folder named "20250303 1-4" on the storage folder FD. Next, as shown in Figure 9C, the captured image data is saved to the created "20250303 1-4" folder. In the example in Figure 9C, the data with the file name "202503030959" is the captured image data. Note that in Figure 9C, the EWF2 format is shown as an example of the data format of the captured image data to be saved, but the data format of the captured image data to be saved may be other formats such as JPEG format or PPTX format.

[0068] If a folder named "20250303 1-4" already exists on the storage folder FD, the second control unit 33 will not create a new folder on the storage folder FD. In this case, the second control unit 33 will save the captured image data to the already created "20250303 1-4" folder.

[0069] When the second control unit 33 saves the captured image data, it displays the second icon IC2 in the folder name setting image G11.

[0070] Figure 10 shows an example of a folder name setting image G11 that displays the second icon IC2. The second icon IC2 is an icon that indicates that captured image data has been saved. Figure 10 shows an example where the second icon IC2 is displayed in the upper left corner of the date information J1, but the display position of the second icon IC2 is not limited to the position shown in Figure 10. Furthermore, the image of the second icon IC2 is not limited to the image shown in Figure 10. For example, the image of the second icon IC2 may indicate the number of times the first icon IC1 has been operated since the first folder information J2 was displayed in the folder information display area A2. In other words, the image of the second icon IC2 may indicate the number of times captured image data has been saved since the first folder information J2 was displayed in the folder information display area A2.

[0071] [1-3. Operation of each part of the projection system] Next, the operation of each part of the projection system 1 in this embodiment will be described. First, referring to Figure 11, the operation of the information processing device 3 related to the setting of the first folder information J2 will be explained. Figure 11 is a flowchart showing the operation of the information processing device 3.

[0072] The second control unit 33 determines whether or not it has received an operation to select folder information display area A2 (step SA1).

[0073] If the second control unit 33 determines that it has not received an operation to select folder information display area A2 (step SA1: NO), it performs the determination in step SA1 again.

[0074] On the other hand, if the second control unit 33 determines that it has received an operation to select the folder information display area A2 (step SA1: YES), it determines whether or not the history information 313 contains the first folder information J2 (step SA2).

[0075] If the second control unit 33 determines that the history information 313 contains the first folder information J2 (step SA2: YES), it displays the list image G4 on the folder name setting image G11 (step SA3).

[0076] Next, the second control unit 33 determines whether or not it has received an operation to select the first folder information J2 (step SA4).

[0077] If the second control unit 33 determines that it has received an operation to select the first folder information J2 (step SA4: NO), it displays the selected first folder information J2 in the folder information display area A2 (step SA5).

[0078] On the other hand, if the second control unit 33 determines that it has not received an operation to select the first folder information J2 (step SA4: NO), it determines whether or not an operation to input the first folder information J2 has been received via a keyboard or the like (step SA6).

[0079] When the second control unit 33 receives an operation to input the first folder information J2 (step SA6: YES), it displays the first folder information J2 input by that operation in the folder information display area A2 (step SA7).

[0080] On the other hand, if the second control unit 33 has not received an operation to input the first folder information J2 (step SA6: NO), it returns to step SA4 and performs the process of step SA4 again.

[0081] Returning to the explanation of step SA2, if the second control unit 33 determines that the history information 313 does not contain the first folder information J2 (step SA2: NO), it determines whether or not an operation to input the first folder information J2 has been received via keyboard or the like (step SA8).

[0082] When the second control unit 33 receives an operation to input the first folder information J2 (step SA8: YES), it displays the first folder information J2 input by that operation in the folder information display area A2 (step SA9).

[0083] On the other hand, if the second control unit 33 has not received an operation to input the first folder information J2 (step SA8: NO), it returns to step SA1 and performs the process of step SA1 again.

[0084] Next, we will explain the operation of Projector 2 related to the display of the first icon IC1. Figure 12 is a flowchart showing the operation of Projector 2.

[0085] The first control unit 26 determines whether or not it has established a communication connection with the information processing device 3 (step SB1). If the first control unit 26 determines that it has not established a communication connection with the information processing device 3 (step SB1: NO), it performs the determination in step SB1 again.

[0086] On the other hand, if the first control unit 26 determines that it has established a communication connection with the information processing device 3 (step SB1: YES), it displays the first icon IC1 on the projection surface 4 (step SB2).

[0087] Next, we will explain the operations involved in saving captured image data. First, referring to Figure 13, we will explain the operation when Projector 2 and Information Processing Device 3 do not share their screens.

[0088] Figure 13 is a flowchart showing the operation of Projector 2 and Information Processing Device 3. In Figure 13, the flowchart on the right shows the operation of Projector 2, and the flowchart on the left shows the operation of Information Processing Device 3.

[0089] At the start of operation in Figure 13, Projector 2 is displaying the first icon IC1. Also at the start of operation in Figure 13, Folder information display area A2 is displaying the first folder information J2.

[0090] The first control unit 26 determines whether or not it has received an operation to select the first icon IC1 (step SC1).

[0091] If the first control unit 26 determines that it has not received an operation to select the first icon IC1 (step SC1: NO), it performs the process of step SC1 again.

[0092] On the other hand, if the first control unit 26 determines that it has received an operation to select the first icon IC1 (step SC1: YES), it transmits the captured image data to the information processing device 3 (step SC2).

[0093] Step SC2 will be described in detail. If the image displayed on the projection surface 4 is an image supplied by the information processing device 3, the first control unit 26 transmits the image data of the image supplied by the information processing device 3 to the information processing device 3 as captured image data. If the image displayed on the projection surface 4 is the third image G3 drawn by the operation of the projection surface 4, the first control unit 26 transmits the image data of the third image G3 as captured image data to the information processing device 3. If the image displayed on the projection surface 4 is an image supplied by the information processing device 3 and a third image G3 drawn by the operation of the projection surface 4, the first control unit 26 transmits the image data of the image in which the third image G3 is superimposed on the image supplied by the information processing device 3 as captured image data to the information processing device 3.

[0094] The second control unit 33 receives captured image data from the projector 2 (step SD1).

[0095] Next, the second control unit 33 determines whether or not a folder with a folder name composed of the date information J1 and the first folder information J2 exists in the storage folder FD (step SD2).

[0096] If the second control unit 33 determines that the folder does not exist in the storage folder FD (step SD2: NO), it creates a folder in the storage folder FD with a folder name composed of date information J1 and first folder information J2 (step SD3).

[0097] Next, the second control unit 33 saves the captured image data received in step SD1 to the folder created in step SD3 (step SD4).

[0098] Returning to the explanation of step SE2, the second control unit 33 determines that the data exists in the storage folder FD (step SD2: YES), and saves the captured image data received in step SD1 to a folder named by the date information J1 and the first folder information J2 (step SD5).

[0099] Next, referring to Figure 14, we will explain the operation when the projector 2 and the information processing device 3 are sharing the screen.

[0100] Figure 14 is a flowchart showing the operation of Projector 2 and Information Processing Device 3. In Figure 14, the flowchart on the right shows the operation of Projector 2, and the flowchart on the left shows the operation of Information Processing Device 3. In Figure 14, the same reference numerals are used for the same steps as in Figure 13. Furthermore, in the explanation of Figure 14, detailed explanations of the same steps as in Figure 13 are omitted where appropriate.

[0101] At the start of operation in Figure 14, Projector 2 is displaying the first icon IC1. Also at the start of operation in Figure 14, Folder information display area A2 is displaying the first folder information J2. Also at the start of operation in Figure 14, Projector 2 is displaying the image supplied by the information processing device 3 on the projection surface 4.

[0102] If the first control unit 26 determines that it has received an operation to select the first icon IC1 (step SC1: YES), it transmits the image data of the image displayed on the projection surface 4 to the information processing device 3 (step SE1).

[0103] Step SE1 will be described in detail. When projector 2 and information processing device 3 share a screen, information processing device 3 supplies the first image G1 and the second image G2 to projector 2. If the images displayed on the projection surface 4 are the first image G1 and the second image G2, the first control unit 26 transmits the image data of the second image G2 as captured image data to the information processing device 3. Furthermore, if the images displayed on the projection surface 4 are the first image G1, the second image G2, and the third image G3, the first control unit 26 transmits the image data of the image in which the third image G3 is superimposed on the second image G2 as captured image data to the information processing device 3.

[0104] Next, the effects of this embodiment will be explained by illustrating the case in which the projection system 1 is used in a classroom setting. In this classroom setting, the teacher connects the information processing device 3 that they have brought with them to the projector 2 and displays the materials used in the lesson on the projection surface 4 to conduct the lesson. When the teacher sets the folder name for saving the captured image data, they only need to select the first folder information J2 in the first image G1 displayed by the information processing device 3. Therefore, there is no need to operate the keyboard when setting the folder name, and the image displayed on the projection surface 4 can be easily saved. Even if the teacher were to operate the keyboard when setting the destination folder name, the folder name can be set using the keyboard of the information processing device 3, so the teacher can set the folder name using a familiar keyboard. In addition, the teacher can save the captured image data simply by selecting the first icon IC1 displayed by the projector 2. Therefore, compared to a configuration in which the teacher operates the information processing device 3 to save the captured image data, the teacher can save the captured image data without having to go back and forth between the projection surface 4 and the information processing device 3.

[0105] [2. Second Embodiment] Next, a second embodiment will be described. The second embodiment differs from the first embodiment in the operation related to saving captured image data when the projector 2 and the information processing device 3 are sharing a screen.

[0106] Figure 15 is a flowchart showing the operation of Projector 2 and Information Processing Device 3. In Figure 15, the flowchart on the right shows the operation of Projector 2, and the flowchart on the left shows the operation of Information Processing Device 3. In Figure 15, the same reference numerals are used for the same steps as in Figure 14. Furthermore, in the explanation of Figure 15, detailed explanations of the same steps as in Figure 14 are omitted where appropriate.

[0107] If the first control unit 26 determines that it has received an operation to select the first icon IC1 (step SC1: YES), it sends request information to the information processing device 3 requesting that the first image G1 be hidden (step SF1).

[0108] When the second control unit 33 receives request information from the projector 2 (step SG1), it hides the first image G1 (step SG2).

[0109] Next, the second control unit 33 sends completion information to the projector 2 indicating that the first image G1 has been hidden (step SG3).

[0110] When the first control unit 26 receives completion information from the information processing device 3 (step SF2), it transmits the captured image data to the information processing device 3 (step SF3).

[0111] Step SG3 will be described in detail. When step SG3 is processed, the first image G1 is not displayed, so the information processing device 3 supplies the second image G2 to the projector 2. If the image displayed on the projection surface 4 is the second image G2, the first control unit 26 transmits the image data of the second image G2 as captured image data to the information processing device 3. Furthermore, if the images displayed on the projection surface 4 are the second image G2 and the third image G3, the first control unit 26 transmits the image data of the image in which the third image G3 is superimposed on the second image G2 as captured image data to the information processing device 3.

[0112] When the second control unit 33 saves the image data, it displays the first image G1 again (step SG4). As a result, the first image G1 is displayed again on the projection surface 4.

[0113] [3. Other Embodiments] The embodiments described above are preferred embodiments of the present disclosure. However, the present invention is not limited to the embodiments described above, and various modifications can be made without departing from the spirit of the present disclosure.

[0114] In the embodiment described above, the case where the "second folder information" is date information J1 was illustrated as an example. In other embodiments, the "second folder information" may be date and time information in addition to the date.

[0115] Furthermore, in the embodiment described above, date information J1 is used as an example of "second folder information," and the case where "second folder information" is automatically determined is illustrated. In other embodiments, "second folder information" may also be selectable and input in the folder name setting image G11, similar to the first folder information J2. In this configuration, the information processing device 3 displays a list image of the second folder information, similar to the first folder information J2, and accepts the operation to select the second folder information via the list image. In this configuration, the information processing device 3 stores the "second folder information" used as the folder name for saving the captured image data as history in the local folder, and displays the list image based on the stored history. Furthermore, the "second folder information" stored in this local folder may also be editable, similar to the first folder information J2.

[0116] Furthermore, although the above-described embodiment uses a projector 2 as an example of a "display device," the "display device" is not limited to a projector 2, but may be a display device equipped with a touch panel and capable of operating the display surface of the touch panel.

[0117] Alternatively, the history information 313 may be configured as text data stored in the storage folder FD, and the first folder information J2 included in the history information 313 may be written as text in the text data. In this configuration, the information processing device 3 accepts editing of the first folder information J2 included in the history information 313 by accepting editing of the text written in the text data. In this configuration, the information processing device 3 may not display the edited image G12.

[0118] Furthermore, the functions of the first control unit 26 and the second control unit 33 may be realized by multiple processors or semiconductor chips.

[0119] Furthermore, the parts of the projector 2 shown in Figure 3 and the parts of the information processing device 3 shown in Figure 5 represent functional configurations, and the specific implementation form is not particularly limited. In other words, it is not necessarily required that hardware corresponding to each functional part be implemented individually; a single processor may execute a program to realize multiple functions. Also, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other parts of the projector 2 and the information processing device 3 can be arbitrarily changed without departing from the spirit of this disclosure.

[0120] Furthermore, the processing units in the flowcharts shown in Figures 11, 12, 13, 14, and 15 are divided according to the main processing content in order to facilitate understanding of the processing between the projector 2 and the information processing device 3, and this disclosure is not limited by the way the processing units are divided or the names of the units. Depending on the processing content, it may be divided into many step units. Alternatively, it may be divided so that one step unit includes many processes. Also, the order of the steps may be changed as appropriate, as long as it does not hinder the intent of this disclosure.

[0121] [4. Summary of this disclosure] A summary of this disclosure is provided below.

[0122] (Note 1) Image data storage method comprising: an information processing device communicating with a display device that displays an image on a display surface receiving an operation to select first folder information; the display device displaying a first icon for saving the image displayed on the display surface; the display device receiving an operation to select the first icon to display; and the information processing device saving image data of the image displayed on the display surface in a folder named based on second folder information and the first folder information. This allows users to set folder names without using the keyboard, making it easy to save image data of images displayed on the screen. Furthermore, users can save image data simply by selecting the first icon displayed by the display device. Therefore, compared to configurations where users must operate an information processing device to save image data, this allows users to save image data without having to switch between the display screen and the information processing device.

[0123] (Note 2) The image data storage method described in Appendix 1, wherein the folder with the aforementioned folder name is a local folder of the information processing device. This allows image data to be saved to a folder that the display device cannot access. Therefore, image data can be saved to a local folder without the hassle of downloading it from a shared folder.

[0124] (Note 3) The first folder information is stored in the local folder of the information processing device, according to the image data storage method described in Appendix 1 or Appendix 2. This allows the user to select the first folder information from among the first folder information stored on the information processing device they are operating. Therefore, compared to the case where the first folder information is stored in a shared folder shared by multiple information processing devices, the number of options for the first folder information can be reduced, thus preventing the operation of setting the folder name from becoming cumbersome.

[0125] (Note 4) The aforementioned second folder information includes date information indicating the date, and is an image data storage method described in any one of the appendices 1 to 3. This configuration, which includes date information in the second folder information, prevents duplicate folder names in the folders where image data is saved, even if the same first folder information is set on different days.

[0126] (Note 5) The method for saving image data according to any one of the appendices 1 to 4, wherein the display device displays a first image displayed by the information processing device according to an application program stored in the information processing device, a second image other than the first image displayed by the information processing device, and a third image drawn by an operation on the display surface, wherein the second image is an image that accepts an operation to select the first folder information, and saving includes saving the image data in which the first image and the third image are superimposed. This allows for the storage of image data that does not contain images, which is then selected as the first folder, thereby improving the visibility of the images represented by the stored image data.

[0127] (Note 6) The image data storage method according to any one of Appendix 1 to Appendix 5, wherein the information processing device accepts an operation to select the second folder information. This allows you to set folder names without using the keyboard, making it easy to save image data of images displayed on the screen.

[0128] (Note 7) The method for saving image data according to any one of the appendices 1 to 6, wherein the display device displays a second icon indicating that the image data has been saved when the image data has been saved. This allows users to easily see that image data is saved in a folder without having to open that folder.

[0129] (Note 8) The method for saving image data according to any one of the appendices 1 to 7, wherein the display device displays a first image to be displayed by the information processing device according to an application program stored in the information processing device, and the information processing device hides the first image after the display device has received an operation to select the first icon, and the saving includes saving the image data after the information processing device has hidden the first image. This allows for the storage of image data that does not contain images, which is then selected as the first folder, thereby improving the visibility of the images represented by the stored image data. [Explanation of Symbols]

[0130] 1 Projection system, 2...Projector (display device), 3...Information processing device, 4...Projection surface (display surface), 5...Projection area, 6...Indicator, 20...First communication I / F, 21...Image processing unit, 22...Frame memory, 23...Projection unit, 24...Ejection unit, 25...Infrared camera, 26...First control unit, 30...Second communication I / F, 32...Operation unit, 33...Second control unit, 200...First processor, 211...First image processing unit, 212...Second image processing unit, 220...First memory, 221...First control program, 231...Light source, 232...Optical modulator, 233...Optical unit, 30 0...Second processor, 310...Second memory, 311...Second control program, 312...Application program, 313...History information, A1...Folder name setting area, A2...Folder information display area, B1...First button, B2...Second button, B3...Third button, G1...First image, G11...Folder name setting image, G12...Editing image, G2...Second image, G3...Third image, G4...List image, HA...Range, IC1...First icon, IC2...Second icon, J1...Date information (Second folder information), J2...First folder information, LT...Detection light.

Claims

1. An information processing device that communicates with a display device that displays an image on its surface accepts an operation to select first folder information, The display device displays a first icon for saving the image displayed on the display surface, The display device accepts an operation to select the first icon to be displayed, The information processing device includes storing image data of the image displayed on the display surface in a folder named based on the second folder information and the first folder information. How to save image data.

2. The folder with the aforementioned folder name is a local folder of the information processing device. The method for storing image data according to claim 1.

3. The first folder information is stored in the local folder of the information processing device. The method for storing image data according to claim 1 or 2.

4. The aforementioned second folder information includes date information indicating the date, The method for storing image data according to claim 1 or 2.

5. The display device includes superimposing and displaying a first image displayed by the information processing device according to an application program stored in the information processing device, a second image other than the first image displayed by the information processing device, and a third image drawn by an operation on the display surface. The second image is an image that accepts the operation to select the first folder information. The aforementioned saving includes saving the image data obtained by superimposing the first image and the third image. The method for storing image data according to claim 1 or 2.

6. The information processing device includes receiving an operation to select the second folder information, The method for storing image data according to claim 1 or 2.

7. The display device includes, when the image data is saved, displaying a second icon indicating that the image data has been saved. The method for storing image data according to claim 1 or 2.

8. The display device displays a first image that the information processing device displays according to an application program stored in the information processing device, The information processing device includes hiding the first image after the display device has received an operation to select the first icon, The aforementioned preservation is The information processing device includes saving the image data after hiding the first image. The method for storing image data according to claim 1 or 2.

Images