Display screen storage method and display system

Abstract

Provided are a display screen storage method and a display system. Provided are a display screen storage method and a display system that improve user convenience. The method includes: accepting, by a projector (100), a capture request; the projector (100) captures a projection image and generates first saved data. Transmitting, by the projector (100), the first saved data to the information processing device (200); saving the first save data in the AP file (265) by the information processing device (200); the projector (100) receives a capture request. Capturing a projection image by the projector (100) and generating second saved data; transmitting, by the projector (100), the second saved data to the information processing device (200); and storing the second stored data in the AP file (265) by the information processing device (200).

Description

Technical Field

[0001] The present invention relates to a display screen storage method and a display system. Background Art

[0002] Conventionally, there is known a system that displays a display image based on image data on a display surface and displays a drawing such as a line or a graphic on the display surface at a position on the display surface pointed by a pointer such as an electronic pen.

[0003] For example, the image supply device of Patent Document 1 detects the indicated position of a pointer of a pen-shaped device based on data received from a projector, and draws a line or a graphic along the trajectory of the detected position.

[0004] Patent Document 1: Japanese Patent Application Laid-Open No. 2012-194850

[0005] For example, there is a need to save an image displayed on a display surface by a display device or a note drawn on the display surface by a user using a pointer in a file in advance so that the note can be viewed later. However, if each time a user inputs a capture instruction, the note is saved in a separate file, or if the display image and the note are saved separately, the user's workload increases when combining the notes into a file in a format that is easy for the user to view. Summary of the Invention

[0006] One method disclosed herein is a method for saving a display screen, which includes: a display device accepting a capture request for a first screen displayed on a display surface by the display device; the display device capturing the first screen to generate first data; the display device sending the first data to an information processing device; the information processing device saving the first data to a first application file; the display device accepting a capture request for a second screen displayed on the display surface by the display device; the display device capturing the second screen to generate second data; the display device sending the second data to the information processing device; and the information processing device saving the second data to the first application file.

[0007] One embodiment of the present disclosure is a display system comprising an information processing device and a display device that displays a display screen on a display surface, wherein the display device comprises: a first communication unit; an acceptance unit that accepts an operation; an optical device that displays a display screen on the display surface; and a first control unit, wherein the first control unit performs the following control: the acceptance unit accepts a capture request for a first screen displayed on the display surface by the optical device; the first screen is captured to generate first data; the first communication unit sends the first data to the information processing device; the acceptance unit accepts a capture request for a second screen displayed on the display surface by the optical device; the second screen is captured to generate second data; and the first communication unit sends the second data to the information processing device, wherein the information processing device comprises a second communication unit and a second control unit, wherein the second control unit performs the following control: the second communication unit saves the first data received from the display device to a first application file; and the second communication unit saves the second data received from the display device to the first application file. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 : is a diagram showing the system configuration of a display system.

[0009] Figure 2 is a block diagram showing the structure of a projector.

[0010] Figure 3 It is a block diagram showing the structure of an information processing device.

[0011] Figure 4 A diagram showing an example of a display screen.

[0012] Figure 5 This is a flowchart showing the operation of the projector.

[0013] Figure 6 This is a flowchart showing the operation of the information processing device.

[0014] Description of labels

[0015] 1: Display system; 3: Communication network; 5: Indicator; 30: Menu image; 31: Projected image; 33: Draw image; 35: Capture icon; 100: Projector; 105: Remote controller; 110: Light receiving unit; 120: First communication I / F; 130: Image processing unit; 135: Frame memory; 140: Projection unit; 141: Light source; 143: Light modulation device; 145, 145R, 145G, 145B: Liquid crystal panel; 147: Optical unit; 150: Transmitter; 155: First 1: signal light; 157: second signal light; 160: imaging unit; 170: first control unit; 180: first storage unit; 181: control program; 185: calibration data; 190: first processor; 200: information processing device; 210: second communication I / F; 230: operation unit; 250: second control unit; 260: second storage unit; 261: OS; 263: APP; 263A: demonstration APP; 265: AP file; 265A: demonstration file; 270: second processor. DETAILED DESCRIPTION

[0016] 1. Configuration of the Display System of the First Embodiment

[0017] Hereinafter, a first embodiment will be described with reference to the drawings.

[0018] Figure 1 1 is a diagram showing the system configuration of the display system 1 .

[0019] The display system 1 includes a projector 100 and an information processing device 200 .

[0020] The projector 100 and the information processing device 200 are connected via the communication network 3. Figure 1 , the information processing device 200 and the projector 100 are connected to the communication network 3 by wire, but the projector 100 and the information processing device 200 may be connected to the communication network 3 by wireless. The communication network 3 includes, for example, a LAN (Local Area Network) or a WAN (Wide Area Network).

[0021] Projector 100 displays an image based on image data supplied from information processing device 200 on display surface 7. Projector 100 generates image light based on the image data supplied from information processing device 200. Projector 100 projects the generated image light onto display surface 7. As a result, an image corresponding to the image data is displayed on display surface 7. The image corresponding to the image data is referred to as display image 31.

[0022] The projector 100 detects the operation of the indicator 5 on the display surface 7 and displays a line image at the position on the display surface 7 where the operation is detected. The indicator 5 is an electronic pen and includes: a light-emitting unit that emits infrared light; and a pressure detection unit that detects the pressure of the front end of the indicator 5 on the display surface 7, that is, the touch of the display surface 7. As the pressure detection unit, a pressure-sensitive switch can be used, for example. The illustration of the light-emitting unit and the pressure detection unit is omitted. While the indicator 5 is operating, the light-emitting unit repeatedly flashes in a prescribed light-emitting sequence. In addition, the light-emitting unit changes the light-emitting sequence according to whether the display surface 7 is touched. Therefore, the projector 100 can recognize the presence or absence of a touch by the indicator 5 based on the light-emitting sequence of the light-emitting unit.

[0023] The projector 100 includes an imaging unit 160 whose viewing angle is adjusted so as to be able to capture at least a portion of the display surface 7. The projector 100 detects light emitted by the indicator 5 from the image captured by the imaging unit 160 and detects the position of the detected light as the indicated position indicated by the indicator 5. Furthermore, the projector 100 detects the presence or absence of a touch on the display surface 7 based on the emission sequence of the detected light. The projector 100 generates line image data, i.e., drawing data, corresponding to the trajectory of the detected indicated position, and displays the generated drawing data on the display surface 7.

[0024] The information processing device 200 supplies the projector 100 with image data displayed by the projector 100. As the information processing device 200, for example, a personal computer such as a desktop, notebook, or tablet, or a portable terminal such as a smartphone is used.

[0025] 2. Structure of the Projector According to the First Embodiment

[0026] Figure 2 2 is a block diagram showing the structure of the projector 100 .

[0027] Reference Figure 2 The structure of the projector 100 will be described.

[0028] The projector 100 includes a light receiving unit 110, a first communication interface 120, an image processing unit 130, a frame memory 135, a projection unit 140, a transmission unit 150, an imaging unit 160, and a first control unit 170. Hereinafter, the interface is simply referred to as I / F.

[0029] Light receiving unit 110 receives an infrared signal transmitted from remote controller 105. Light receiving unit 110 outputs an operation signal corresponding to the received infrared signal to first control unit 170. The operation signal is a signal corresponding to the switch of remote controller 105 being operated.

[0030] The first communication I / F 120 includes a communication card such as a NIC (Network Interface Card), and performs data communication with the information processing device 200 via the communication network 3 .

[0031] Frame memory 135 is connected to image processing unit 130. Frame memory 135 includes multiple banks. Each bank has a storage capacity sufficient to store one frame's worth of image data. Frame memory 135 is comprised of, for example, SDRAM (Synchronous Dynamic Random Access Memory). Image processing unit 130 expands image data input from first communication I / F 120 into frame memory 135.

[0032] The image processing unit 130 performs image processing on the image data expanded in the frame memory 135. The image processing performed by the image processing unit 130 includes, for example, resolution conversion and resizing, distortion correction, shape correction, digital zoom, and image hue and brightness adjustment. The image processing unit 130 executes the processing specified by the first control unit 170, using parameters input from the first control unit 170 as needed. Furthermore, the image processing unit 130 can, of course, perform a combination of multiple image processing operations described above. Upon completion of image processing, the image processing unit 130 reads the data expanded in the frame memory 135 as display data and outputs the read display data to the panel driver of the light modulator 143. Illustration of the panel driver is omitted.

[0033] Image processing unit 130 and frame memory 135 are configured, for example, by integrated circuits. Examples of integrated circuits include LSIs (Large Scale Integration), ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), FPGAs (Field-Programmable Gate Arrays), and SoCs (System-on-a-Chip). Furthermore, analog circuits may be incorporated into a portion of the integrated circuit structure, or a combination of the first control unit 170 and an integrated circuit may be employed.

[0034] The projection unit 140 includes a light source 141 , a light modulator 143 , and an optical unit 147 .

[0035] Light source 141 includes a discharge-type light source lamp such as an ultrahigh pressure mercury lamp or a metal halide lamp, or a solid-state light source such as a light emitting diode or a semiconductor laser. Light emitted from light source 141 is separated into red, green, and blue light by a color separation optical system (not shown).

[0036] The light modulator 143 includes three liquid crystal panels 145R, 145G, and 145B corresponding to the red, green, and blue color components. Hereinafter, the liquid crystal panels 145R, 145G, and 145B will be collectively referred to as liquid crystal panels 145. Colored light separated into red, green, and blue color components by the color separation optical system enters the liquid crystal panels 145R, 145G, and 145B, respectively.

[0037] The liquid crystal panels 145R, 145G, and 145B are each a transmissive liquid crystal panel having liquid crystal sealed between a pair of transparent substrates. The liquid crystal panel has a pixel region composed of a plurality of pixels arranged in a matrix, and a driving voltage can be applied to the liquid crystal for each pixel.

[0038] The light modulator 143 includes a panel driver that drives the liquid crystal panels 145R, 145G, and 145B. The panel driver applies a driving voltage corresponding to the input display data to each pixel in the pixel area, and sets the transmittance of each pixel to the display data. The light emitted from the light source 141 passes through the pixel area of ​​the liquid crystal panel, thereby being modulated for each pixel, and forming image light corresponding to the display data for each color light. The image light of each color formed is synthesized for each pixel by a color synthesis optical system (not shown) to become image light representing a color image. The optical unit 147 includes a projection lens, etc., which amplifies the image light modulated by the liquid crystal panel 145 and projects it onto the display surface 7. As a result, the display image 31 based on the image data is displayed on the display surface 7.

[0039] The transmitter 150 includes, for example, a light source such as an LED and a device for controlling the lighting and extinguishing of the light source. The device for controlling the light source can be formed of, for example, an ASIC or an FPGA.

[0040] The transmitter 150 outputs a first signal light 155, which is a signal for synchronizing the light emission timing of the indicator 5 with the imaging timing of the imaging unit 160. The first signal light 155 is a near-infrared light signal that can be received by the indicator 5. The transmitter 150 periodically transmits the first signal light 155 during the activation of the projector 100.

[0041] First signal light 155 is a control signal that instructs the pointer 5 to emit second signal light 157. First signal light 155 is near-infrared light having a predetermined emission pattern. For example, the pointer 5 emits second signal light 157 in synchronization with the timing of receiving first signal light 155. The projector 100 causes the imaging unit 160 to perform imaging in sync with the timing of the pointer 5 emitting second signal light 157.

[0042] The imaging unit 160 is a camera equipped with an imaging element (not shown), such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The imaging unit 160 includes an infrared-transmitting filter that absorbs visible light but transmits infrared light. The infrared light emitted from the indicator 5 is captured through this infrared-transmitting filter. Under the control of the first control unit 170, the imaging unit 160 repeatedly captures images of the display surface 7 and sequentially outputs the captured images to the first control unit 170.

[0043] The first control unit 170 is a computer device including a first storage unit 180 and a first processor 190 .

[0044] The first storage unit 180 includes memories such as RAM (Random Access Memory) and ROM (Read Only Memory). RAM temporarily stores various data, and ROM stores control programs for controlling the operation of the projector 100 and various setting information.

[0045] The first storage unit 180 stores a control program 181 and calibration data 185 .

[0046] The control program 181 is a program such as firmware or an application program executed by the first processor 190 .

[0047] Calibration data 185 is data that associates the coordinates of the image captured by imaging unit 160 with the coordinates of frame memory 135. A two-dimensional coordinate system is set between the captured image and frame memory 135, and calibration data 185 is used to uniquely identify the coordinates of frame memory 135 corresponding to the coordinates on the captured image.

[0048] The first processor 190 is an arithmetic processing device composed of a CPU (Central Processing Unit) and an MPU (MicroProcessing Unit). The first processor 190 executes the control program 181 to control each part of the projector 100. The first processor 190 can be composed of a single processor or a plurality of processors. In addition, the first processor 190 can also be composed of an SoC integrated with a part or all of the first storage unit 180 and other circuits. In addition, the first processor 190 can also be composed of a combination of a CPU that executes programs and a DSP that performs predetermined arithmetic processing. In addition, the first processor 190 can be configured as a structure in which all functions are installed in hardware, or it can be configured using a programmable device.

[0049] The first control unit 170 detects infrared light emitted by the indicator 5 from the captured image input from the camera unit 160. The first control unit 170 identifies infrared light images within the captured image that have a brightness greater than a predetermined threshold and a size within a predetermined range as light emitted by the indicator 5. The first control unit 170 detects the indicated position of the indicator 5 based on the position of the light emitted by the indicator 5 in the captured image. Furthermore, the first control unit 170 determines the light emission sequence of the indicator 5 based on the captured images acquired multiple times, and detects whether the display surface 7 is touched.

[0050] Based on the detection result of the indicated position, the first control unit 170 generates drawing data that depicts a line along the trajectory of the indicated position. For example, when the user performs a drawing operation such as drawing on the display surface 7 using the indicator 5, that is, when the indicated position changes while the indicator 5 is touching the display surface 7, the first control unit 170 generates drawing data based on the trajectory of the indicated position.

[0051] 3. Configuration of the Information Processing Device in the First Embodiment

[0052] Figure 3 2 is a block diagram showing the structure of the information processing device 200. Figure 3 The configuration of the information processing device 200 will be described.

[0053] The information processing device 200 includes a second communication I / F 210 , a display unit 220 , an operation unit 230 , and a second control unit 250 .

[0054] The second communication I / F 210 includes a communication card such as a NIC, for example, and performs data communication with the projector 100 via the communication network 3 .

[0055] The display unit 220 includes a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel, and displays an image based on image data input from the second control unit 250. Alternatively, the display unit 220 may be formed of a touch panel.

[0056] The operation unit 230 includes input devices such as a mouse and a keyboard, and receives user operations. The operation unit 230 outputs an operation signal corresponding to the received operation to the second control unit 250. The second control unit 250 determines that an operation has been received when the operation signal is input from the operation unit 230.

[0057] The second control unit 250 includes a second storage unit 260 and a second processor 270 .

[0058] The second storage unit 260 includes a volatile memory such as RAM and a nonvolatile memory such as ROM. In addition, the second storage unit 260 includes an auxiliary storage device such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive).

[0059] The second storage unit 260 stores control programs such as an OS (Operating System) 261 and application programs 263 executed by the second processor 270. Hereinafter, the application programs 263 are referred to as APP 263. The APP 263 includes document applications such as Word, Excel, and PowerPoint.

[0060] The second storage unit 260 also stores an application file 265. Hereinafter, the application file will be referred to as an AP file 265. The AP file 265 is generated by the second processor 270 that executes the APP 263 and is stored in the second storage unit 260.

[0061] The second processor 270 is an arithmetic processing device composed of a CPU or an MPU. The second processor 270 may be composed of a single processor or multiple processors. Alternatively, the second processor 270 may be composed of a SoC integrated with part or all of the second storage unit 260 and other circuits. Alternatively, the second processor 270 may be composed of a combination of a CPU that executes programs and a DSP that performs predetermined arithmetic processing. Furthermore, the functions of the second processor 270 may all be implemented in hardware, or may be constructed using a programmable device.

[0062] 4. Operations of the Projector and Information Processing Device of the First Embodiment

[0063] Figure 4This figure shows an example of a projected image displayed on display surface 7. The projected image is an image displayed by projecting image light onto display surface 7 by projector 100, and includes a display image 31, a depicted image 33, an OSD (On Screen Display) menu image 30, and the like. The projected image corresponds to the first screen and the second screen. When a capture operation, described later, is accepted, the projected image displayed on display surface 7 is the first screen and the second screen. More specifically, when the first capture operation is accepted, the projected image displayed on display surface 7 corresponds to the first screen, and when the second capture operation is accepted, the projected image displayed on display surface 7 corresponds to the second screen.

[0064] The depicted image 33 is an image corresponding to the trajectory of the indicated position indicated by the user using the indicator 5. The first control unit 170 analyzes the image captured by the imaging unit 160 and detects the indicated position indicated by the indicator 5. The first control unit 170 generates depicted data, which is line image data corresponding to the detected trajectory of the indicated position, and outputs the generated depicted data to the image processing unit 130. The image processing unit 130 overlays the depicted data on the frame memory 135, which has expanded the image data, and outputs the data expanded in the frame memory 135 as display data to the panel driver of the light modulator 143. As a result, the display image 31 and the depicted image 33 are displayed on the display surface 7.

[0065] The menu image 30 includes icons for accepting operations for changing the thickness or color of a line drawn by the indicator 5 . The menu image 30 also displays a capture icon 35 for instructing capture of a display image displayed on the display screen 7 .

[0066] When the user instructs the projector 100 to capture, the user causes the tip of the pointer 5 to overlap with the capture icon 35 and stops the movement of the pointer 5 overlapping with the capture icon 35 for a predetermined period of time. If the tip of the pointer 5 overlaps with the display position of the capture icon 35 for a predetermined period of time, the first control unit 170 determines that the capture operation has been accepted and instructs the image processing unit 130 to generate capture data.

[0067] When receiving the capture operation, the first control unit 170 instructs the image processing unit 130 to capture the image expanded in the frame memory 135 .

[0068] The image processing unit 130 captures the display image 31 based on the image data and the drawn image 33 based on the drawing data in the frame memory 135, generating captured data. The captured data includes the display image 31 and the drawn image 33. The image processing unit 130 outputs the generated captured data to the first control unit 170.

[0069] The first control unit 170 generates storage data to be transmitted to the information processing device 200 based on the captured data input from the image processing unit 130 .

[0070] When the captured data input from the image processing unit 130 includes the display image 31 and the rendered image 33 , the first control unit 170 transmits the captured data to the information processing device 200 as stored data.

[0071] Each time the first control unit 170 determines that a capture operation has been accepted, it generates saved data. For example, the saved data generated when the capture operation is accepted for the first time is referred to as the first saved data, and the saved data generated when the capture operation is accepted for the second time is referred to as the second saved data. The first saved data corresponds to the first data, and the second saved data corresponds to the second data. Similarly, hereinafter, the saved data generated when the capture instruction is input for the Nth time (N is an arbitrary natural number) is referred to as the Nth saved data.

[0072] Next, the operation of the information processing device 200 will be described.

[0073] The second control unit 250 receives the stored data transmitted from the projector 100 via the second communication I / F 210 .

[0074] Upon receiving the saved data, second control unit 250 determines whether a pre-set application 263 is already running. In this embodiment, the pre-set application 263 is described as a presentation application such as PowerPoint. However, it may also be a document application such as Word or Excel. Hereinafter, the presentation application will be referred to as presentation application 263A.

[0075] If the demo app 263A is not running, the second control unit 250 starts the demo app 263A and pastes the captured data included in the received saved data into the AP file 265. The AP file 265 generated by the demo app 263A is referred to as a demo file 265A. The demo file 265A corresponds to the first application file.

[0076] For example, assume that second saved data is received after first saved data is received from projector 100. In this case, second control unit 250 obtains the captured data included in the received first saved data and saves the obtained captured data in presentation file 265A. After saving the captured data included in the first saved data in presentation file 265A, second control unit 250, upon receiving second saved data from projector 100, obtains the captured data included in the second saved data. Second control unit 250 saves the obtained captured data in the same presentation file 265A.

[0077] Furthermore, when the second control unit 250 receives an operation to save the presentation file 265A through the operation unit 230 , the second control unit 250 causes the second storage unit 260 to store the presentation file 265A.

[0078] While projector 100 and information processing device 200 are connected to communication network 3, second control unit 250 continues to store the captured data included in the saved data in the same presentation file 265A. Specifically, even if the display of presentation file 265A is deleted from display unit 220 after operation unit 230 receives an operation to save presentation file 265A, second control unit 250 will store the captured data included in the received saved data in the same presentation file 265A when saving data is received from projector 100.

[0079] In this embodiment, the captured data is stored in the same presentation file 265A while the projector 100 and the information processing device 200 are connected to the communication network 3. However, the captured data may also be stored in different presentation files 265A. For example, after receiving an operation to save presentation file 265A through a user operation and storing presentation file 265A in the second storage unit 260, when new saved data is received, the captured data included in the saved data is saved in a new presentation file 265A. The new presentation file 265A corresponds to the second application file. When the saved data is generated by the projector 100, the projected image displayed on the display surface 7 corresponds to the third screen, and the captured data generated by capturing the projected image corresponding to the third screen corresponds to the third data.

[0080] Figure 5 : is a flowchart showing the operation of the projector 100 .

[0081] Reference Figure 5 The operation of the projector 100 will be described with reference to the flowchart shown in FIG.

[0082] First, upon receiving image data from the information processing device 200, the first control unit 170 generates image light based on the received image data and projects the generated image light onto the display surface 7. As a result, a display image based on the image data is displayed on the display surface 7 (step S1).

[0083] Next, the first control unit 170 determines whether a drawing operation by the indicator 5 has been detected. Specifically, based on the image captured by the imaging unit 160, the first control unit 170 determines whether a drawing operation has been detected in which the tip of the indicator 5 is brought into contact with the display surface 7 and the contacting tip of the indicator 5 is moved on the display surface 7.

[0084] When the first control unit 170 detects a drawing operation (YES in step S2), it generates drawing data, which is data of a line image corresponding to the trajectory of the indicated position where the tip of the indicator 5 contacts the display surface 7. The first control unit 170 displays the drawing image 33 based on the generated drawing data superimposed on the display image (step S3).

[0085] When no drawing operation is detected (No in step S2 ) or when the drawing image 33 is displayed on the display surface 7 (step S3 ), the first control unit 170 determines whether a capture operation is detected (step S4 ).

[0086] When the first control unit 170 detects a capture operation (YES in step S4 ), it captures the image developed on the liquid crystal panel 145 and generates capture data (step S5 ). The image developed on the liquid crystal panel 145 includes the display image and the drawn image 33 .

[0087] Next, the first control unit 170 causes the first storage unit 180 to store the generated captured data (step S6 ).

[0088] Next, the first control unit 170 transmits the stored data including the captured data to the information processing device 200 (step S7 ).

[0089] Here, when a capture operation is detected multiple times, saved data is sent multiple times from projector 100 to information processing device 200. Hereinafter, for ease of explanation, the captured data included in the saved data initially sent from projector 100 to information processing device 200 is referred to as first captured data. The captured data included in the saved data sent secondly from projector 100 to information processing device 200 is referred to as second captured data. The first captured data includes the first display image, and the second captured data includes the second display image.

[0090] Next, the first control unit 170 determines whether the input of image data has been completed (step S8). If the input of image data has not been completed (No in step S8), the first control unit 170 returns to step S2 and determines whether a drawing operation has been detected from the image captured by the imaging unit 160. Furthermore, when the input of image data has been completed (Yes in step S8), the first control unit 170 ends the display of the display image 31 on the display surface 7 (step S9).

[0091] Figure 6 It is a flowchart showing the operation of the information processing device 200.

[0092] Reference Figure 6 The operation of the information processing device 200 is described with reference to the flowchart shown in FIG.

[0093] The second control unit 250 determines whether or not the saved data has been received from the projector 100 (step T1 ). If the second control unit 250 has not received the saved data (No in step T1 ), the second control unit 250 waits until the saved data is received.

[0094] Upon receiving the saved data (YES in step T1 ), the second control unit 250 determines whether the demo app 263A is activated (step T2 ). If the demo app 263A is not activated (NO in step T2 ), the second control unit 250 activates the demo app 263A (step T3 ).

[0095] Next, the second control unit 250 determines whether the presentation file 265A is open (step T4). If the presentation file 265A is not open (No in step T4), the second control unit 250 opens the presentation file 265A (step T5).

[0096] Next, the second control unit 250 acquires the captured data included in the received saved data, and pastes the acquired captured data into the presentation file 265A (step T6 ).

[0097] Next, the second control unit 250 determines whether the network connection with the communication network 3 has been disconnected (step T7). If the network connection with the communication network 3 has been disconnected (yes in step T7), the second control unit 250 determines whether the network connection with the communication network 3 has been reconnected (step T8).

[0098] If the second control unit 250 has not reconnected to the communication network 3 (No in step T8), it determines whether an operation to close the presentation file 265A has been accepted (step T9). If the second control unit 250 has not accepted an operation to close the file (No in step T9), the process returns to step T1. Alternatively, if the second control unit 250 has accepted an operation to close the presentation file 265A (Yes in step T9), it causes the second storage unit 260 to store the presentation file 265A (step T10), thereby closing the presentation file 265A. The second control unit 250 then returns to step T1 to determine whether the saved data has been received.

[0099] Furthermore, if the network connection with the communication network 3 has been reconnected (YES in step T8), the second control unit 250 determines whether a predetermined time has elapsed since the network connection with the communication network 3 was disconnected (step T11). If the predetermined time has not elapsed since the network connection with the communication network 3 was disconnected (NO in step T11), the second control unit 250 returns to the determination in step T8.

[0100] When a predetermined time has passed since the network connection with the communication network 3 was disconnected (YES in step T11 ), the second control unit 250 causes the second storage unit 260 to store the presentation file 265A (step T12 ), closes the presentation file 265A (step T13 ), and ends the processing flow.

[0101] If the network connection is not disconnected (No in step T7), the second control unit 250 determines whether an operation to close the presentation file 265A has been accepted (step T9). If the second control unit 250 has not accepted an operation to close the file (No in step T9), the process returns to step T1. Alternatively, if an operation to close the presentation file 265A has been accepted (Yes in step T9), the second control unit 250 causes the second storage unit 260 to store the presentation file 265A (step T10), thereby closing the presentation file 265A. The second control unit 250 then returns to step T1 to determine whether the saved data has been received.

[0102] 5. Second Implementation

[0103] A second embodiment will be described with reference to the drawings.

[0104] The configuration of the display system 1 according to the second embodiment is the same as that of the first embodiment described above, and therefore the description of the configuration of the display system 1 will be omitted.

[0105] In the second embodiment, the captured data generated by the first control unit 170 does not include data capturing the rendered image 33. The captured data of the second embodiment includes only data capturing the display image 31 based on the image data.

[0106] The image processing unit 130 generates captured data that captures only the display image 31 based on the image data, according to an instruction from the first control unit 170 . The image processing unit 130 outputs the captured data that captures only the display image 31 to the first control unit 170 .

[0107] The first control unit 170 generates saved data containing data capturing the display image 31 and vector data. Vector data is data representing a point having coordinate values, and is data obtained by the first control unit 170 converting drawing data generated based on the trajectory of the indicated position of the indicator 5. Instead of capturing the drawn image 33, the first control unit 170 includes the vector data generated by the first control unit 170 in the saved data. When generating the saved data, the first control unit 170 transmits the generated saved data to the information processing device 200. Vector data corresponds to drawing data. That is, the vector data included in the first saved data corresponds to the first drawing data, and the vector data included in the second saved data corresponds to the second drawing data.

[0108] Upon receiving saved data from the projector 100, the second control unit 250 of the information processing device 200 obtains the captured data and vector data contained in the received saved data. The second control unit 250 converts the obtained vector data into object data. Object data is data that enables functions of the presentation app 263A, such as size changes such as enlargement and reduction, and color conversion. After converting the vector data into object data, the information processing device 200 associates the captured data and object data with each other and pastes them into the presentation file 265A, saving the data in the presentation file 265A.

[0109] When the drawing data is converted into image data such as a bitmap and then pasted into presentation file 265A, for example, the color of the background image previously pasted into presentation file 265A may be changed to white. In contrast, when the drawing data is converted into vector data, since vector data is coordinate data, the background image is not changed to white, and the background image can be prevented from being obscured.

[0110] Furthermore, the second control unit 250 determines whether the vector data obtained from the stored data contains numbers, characters, symbols, etc. If the vector data contains numbers, characters, or symbols, the information processing device 200 converts the data into text data. For example, if the vector data is handwritten text, the second control unit 250 detects characters from the vector data through character recognition processing and converts the detected characters into text data.

[0111] Furthermore, when the second control unit 250 pastes the captured data and object data into the presentation app 263A for storage, it may save the data in the background, rather than displaying the presentation file 265A on the display unit 220. This allows the user to display an image different from the display image 31 on the display unit 220. Furthermore, when the captured data and object data are being saved in the background, the information processing device 200 or the projector 100 connected to the information processing device 200 may notify the user of the information processing device 200 that the data has been saved. This allows the user of the information processing device 200 to recognize that data saving has been completed.

[0112] The above-mentioned embodiment is a preferred embodiment of the present invention. However, the present invention is not limited to the above-mentioned embodiment, and various modifications can be implemented without departing from the scope of the present invention.

[0113] For example, Figure 2 The projector 100 and Figure 3The functional units of the information processing device 200 shown represent functional structures, and the specific implementation method is not particularly limited. In other words, it is not necessary to install hardware corresponding to each functional unit. Of course, a structure in which the functions of multiple functional units are implemented by a single processor executing a program can also be set. In addition, in the above-mentioned embodiment, it is also possible to implement a portion of the functions implemented by software in hardware, and it is also possible to implement a portion of the functions implemented by the hardware of the projector 100 or information processing device 200 in software. In addition, the specific details of the other components of the projector can be arbitrarily changed within the scope of the present invention.

[0114] in addition, Figure 5 The processing units in the flowchart shown are divided according to the main processing contents in order to facilitate understanding of the processing of the projector 100. Figure 6 The processing units in the flowchart shown are processing units divided according to the main processing contents in order to facilitate understanding of the processing of the information processing device 200. Figure 5 and Figure 6 The division method and names of the processing units shown in the flowchart are as follows. Furthermore, the processing of the first control unit 170 of the projector 100 and the second control unit 250 of the information processing device 200 can be divided into more processing units depending on the processing content, and can also be divided so that one processing unit includes more processing. Furthermore, the processing order of the above flowchart is not limited to the example shown in the figure.

[0115] In the above embodiment, the liquid crystal panel 145 included in the light modulator 143 can be either a transmissive or reflective liquid crystal panel. Furthermore, the light modulator 143 can be configured with either a digital micromirror device (DMD) or a combination of a DMD and a color wheel. Furthermore, the light modulator 143 can also employ a structure capable of modulating light emitted by a light source, in addition to a DMDS or DMD.

[0116] Furthermore, in the above embodiment, the projector 100 is used as the display device, but the present invention is not limited to this. For example, the display device may be a liquid crystal display, an organic EL display, a plasma display, or the like. When using such a display, the display may include the transmitter 150 and the image capture unit 160 described in the above embodiment and detect the position of the indicator 5. Alternatively, the display surface of the liquid crystal panel, organic EL panel, or the like may be configured as a touch panel including a display panel and a touch sensor and detect the touch position on the display surface.

[0117] In addition, when the method of saving the display screen is implemented using the computer of the projector 100 and the computer of the information processing device 200, the program for executing these computers can also be constituted in the form of a recording medium. Alternatively, it can also be constituted in the form of a transmission medium for transmitting the program for executing these computers. The recording medium can use a magnetic, optical recording medium or a semiconductor memory device. Specifically, there can be mentioned removable or fixed recording media such as a floppy disk, HDD (Hard Disk Drive), CD-ROM, DVD (Digital Versatile Disc), Blu-ray Disc, optical magnetic disk, flash memory, card-type recording medium, etc. In addition, the above-mentioned recording medium can also be an internal storage device of the server device, that is, a non-volatile storage device such as RAM, ROM, HDD, etc. Blu-ray is a registered trademark.

[0118] In the above embodiment, the display screen 7 includes the display image 31, the depicted image 33, and the OSD menu image 30, but it may not include the display image 31. When the capture operation is received, the depicted image 33 displayed on the display screen 7 becomes the first screen and the second screen.

[0119] 6. Summary of the Disclosure

[0120] The following is a summary of the present disclosure.

[0121] Note 1

[0122] A method for saving a display screen, comprising: accepting, by a display device, a request to capture a first screen displayed on a display surface by the display device; capturing the first screen by the display device to generate first data; sending the first data by the display device to an information processing device; saving the first data to a first application file by the information processing device; accepting, by the display device, a request to capture a second screen displayed on the display surface by the display device; capturing the second screen by the display device to generate second data; sending the second data by the display device to the information processing device; and saving the second data to the first application file by the information processing device.

[0123] Thus, the first data capturing the first screen and the second data capturing the second screen are saved in the first application file. Therefore, the time and effort required to save the data in the application file can be reduced, thereby improving user convenience.

[0124] Note 2

[0125] According to the method for saving a display screen as described in Appendix 1, in the first screen, the display device displays a first display image and a first depiction, the first display image is displayed on the display surface based on image data, the first depiction is displayed on the display surface based on an operation accepted by the display device, the first data includes first captured data obtained by capturing the first display image and first depiction data generated based on the operation, and in the second screen, the display device displays a second display image and a second depiction, the second display image is displayed on the display surface based on image data, the second depiction is displayed on the display surface based on an operation accepted by the display device, the second data includes second captured data obtained by capturing the second display image and second depiction data generated based on the operation.

[0126] This allows the display image and the drawing data generated based on the operation to be saved separately. Therefore, only the drawing data can be edited later, which can improve user convenience.

[0127] Note 3

[0128] A method for saving a display screen according to Note 2, wherein the method for saving a display screen includes: determining by the information processing device whether at least one of the first depiction data and the second depiction data contains at least one of numbers, characters, and symbols; and converting by the information processing device at least one of the numbers, characters, and symbols into text data when at least one of the first depiction data and the second depiction data contains at least one of the numbers, characters, and symbols.

[0129] Thus, when the drawing data includes at least one of numbers, characters, and symbols, these numbers, characters, and symbols are converted into text data. Therefore, when the application file is re-read later, the numbers, characters, and symbols can be easily read.

[0130] Note 4

[0131] The method for saving a display screen according to any one of Notes 1 to 3, wherein saving the first data to the first application file includes: saving in the background by the information processing device, and saving the second data to the first application file includes: saving in the background by the information processing device.

[0132] Thus, the first data is saved in the background to the first application file, and the second data is saved in the background to the first application file. Therefore, even when the display device is displaying the screen of the information processing device, the display screen does not need to be switched, and the progress of the lecture, seminar, etc. will not be interrupted.

[0133] Note 5

[0134] A method for saving a display screen according to any one of Notes 1 to 4, wherein the method for saving a display screen further comprises: when the first data is saved to the first application file, the information processing device notifies that it has been saved to the first application file; and when the second data is saved to the first application file, the information processing device notifies that it has been saved to the first application file.

[0135] Thus, when the first data is saved in the first application file, a notification of the saving is given, and when the second data is saved in the first application file, a notification of the saving is given. Therefore, the user can recognize that the data saving is completed.

[0136] Note 6

[0137] A method for saving a display screen according to any one of Notes 1 to 5, wherein the method for saving a display screen includes: the information processing device accepting an end operation of closing the first application file; the information processing device causing a storage device possessed by the information processing device to store the first application file; the display device accepting a request for capturing a third screen displayed by the display device on the display surface; the display device capturing the third screen to generate third data; the display device sending the third data to the information processing device; and the information processing device saving the third data to a second application file different from the first application file.

[0138] Thus, after the end operation is accepted, when a capture request for the third display screen is accepted, the third data is stored in the second application file that is different from the first application file. Therefore, the application file in which the data is stored can be changed.

[0139] Note 7

[0140] A method for saving a display screen according to any one of Notes 1 to 6, wherein the method for saving a display screen includes: the information processing device accepting the disconnection of the network connection between the information processing device and the display device; the information processing device causing the storage device possessed by the information processing device to store the first application file; the display device accepting a request to capture a third screen displayed by the display device on the display surface; the display device capturing the third screen to generate third data; the display device sending the third data to the information processing device; and the information processing device saving the third data to a second application file different from the first application file.

[0141] Thus, if the network connection between the information processing device and the display device is disconnected, and after receiving the end operation, when receiving a request to capture the third display screen, the third data is saved in a second application file that is different from the first application file. Therefore, the application file in which the data is saved can be changed.

[0142] Note 8

[0143] According to the method for saving a display screen as described in Appendix 1, a first depiction is displayed by the display device in the first screen, the first depiction is displayed on the display surface based on an operation accepted by the display device, and the first data includes first depiction data generated based on the operation; and a second depiction is displayed by the display device in the second screen, the second depiction is displayed on the display surface based on the operation accepted by the display device, and the second data includes second depiction data generated based on the operation.

[0144] Thus, the first data obtained by capturing the first drawing data and the second data obtained by capturing the second drawing data are stored in the first application file. This reduces the time and effort required for storing the data in the application file, thereby improving user convenience.

[0145] Note 9

[0146] A display system comprises an information processing device and a display device that displays a display screen on a display surface, wherein the display device comprises: a first communication unit; an acceptance unit that accepts an operation; an optical device that displays a display screen on the display surface; and a first control unit, wherein the first control unit performs the following control: the acceptance unit accepts a capture request for a first screen displayed by the optical device on the display surface; the first screen is captured to generate first data; the first communication unit sends the first data to the information processing device; the acceptance unit accepts a capture request for a second screen displayed by the optical device on the display surface; the second screen is captured to generate second data; and the first communication unit sends the second data to the information processing device, wherein the information processing device comprises a second communication unit and a second control unit, wherein the second control unit performs the following control: the second communication unit saves the first data received from the display device to a first application file; and the second communication unit saves the second data received from the display device to the first application file.

[0147] Thus, the first data capturing the first display screen and the second data capturing the second display screen are saved in the first application file. Therefore, the time and effort required to save the data in the application file can be reduced, thereby improving user convenience.

Claims

1. A method for saving a display image, comprising: The display device accepts a request to capture a first image displayed on a display surface of the display device; The display device captures the first image to generate first data; The display device sends the first data to the information processing device; The information processing device saves the first data into a first application file; The display device accepts a request to capture the second image displayed on the display surface by the display device; The display device captures the second image to generate second data; The display device transmits the second data to the information processing device; as well as The information processing device stores the second data in the first application file.

2. The method for storing a display screen according to claim 1, wherein: The display device displays a first display image and a first depicted image on the first screen, wherein the first display image is displayed on the display surface based on image data, and the first depicted image is displayed on the display surface based on an operation received by the display device. The first data includes first captured data obtained by capturing the first display image and first drawing data generated based on the operation. The display device displays a second display image and a second depicted image on the second screen, wherein the second display image is displayed on the display surface based on image data, and the second depicted image is displayed on the display surface based on an operation received by the display device. The second data includes second captured data obtained by capturing the second display image and second drawing data generated based on the operation.

3. The method for storing a display screen according to claim 2, wherein: The method for saving the display screen includes: determining, by the information processing device, whether at least one of the first drawing data and the second drawing data includes at least one of a number, a letter, and a symbol; as well as When at least one of the first drawing data and the second drawing data includes at least one of the numbers, characters, and symbols, the information processing device converts the at least one of the numbers, characters, and symbols into text data.

4. The method for storing a display screen according to claim 1, wherein: Saving the first data to the first application file includes: saving the data in the background by the information processing device, Saving the second data in the first application file includes: saving the second data in the background by the information processing device.

5. The method for storing a display screen according to claim 1, wherein: The method for saving the display screen further comprises: When the first data is saved in the first application file, the information processing device notifies that the data has been saved in the first application file; as well as When the second data is stored in the first application file, the information processing device notifies that the second data has been stored in the first application file.

6. The method for storing a display screen according to claim 1, wherein: The method for saving the display screen includes: The information processing device accepts an end operation of closing the first application file; The information processing device causes a storage device included in the information processing device to store the first application file; The display device accepts a request to capture a third image displayed on the display surface by the display device; The display device captures the third image to generate third data; The display device sends the third data to the information processing device; as well as The information processing device stores the third data in a second application file that is different from the first application file.

7. The method for storing a display screen according to claim 1, wherein: The method for saving the display screen includes: The information processing device accepts the disconnection of the network connection between the information processing device and the display device; The information processing device causes a storage device included in the information processing device to store the first application file; The display device accepts a request to capture a third image displayed on the display surface by the display device; The display device captures the third image to generate third data; The display device sends the third data to the information processing device; as well as The information processing device stores the third data in a second application file that is different from the first application file.

8. The method for storing a display screen according to claim 1, wherein: The display device displays a first depicted image on the first screen, wherein the first depicted image is displayed on the display surface based on an operation received by the display device. The first data includes first drawing data generated based on the operation, The display device displays a second depicted image on the second screen, the second depicted image being displayed on the display surface based on an operation received by the display device. The second data includes second drawing data generated based on the operation.

9. A display system comprising an information processing device and a display device for displaying a display screen on a display surface, wherein: The display device comprises: 1st Department of Communications; Acceptance department, its acceptance operations; an optical device that displays a display image on the display surface; and 1st Control Unit, The first control unit performs the following control: The receiving unit receives a request for capturing a first image displayed on the display surface by the optical device; capturing the first image to generate first data; The first communication unit transmits the first data to the information processing device; The receiving unit receives a request for capturing a second image displayed on the display surface by the optical device; capturing the second image to generate second data; and The first communication unit transmits the second data to the information processing device, The information processing device includes a second communication unit and a second control unit. The second control unit performs the following control: storing the first data received from the display device in a first application file by the second communication unit; and The second data received from the display device is stored in the first application file by the second communication unit.

Images