Projection system and control method for projection system

Abstract

To allow sharing of a state where an image such as a projected image from a projection device and handwritten characters are superimposed with each other between a plurality of devices.SOLUTION: A projection system 100 comprising a projection device 1 and a display device 6 causes the projection device 1 to receive an image from the display device 6, project the received image on a projection object OB, photographs a range including the projection object OB, and transmits the photographed image to the display device 6. The projection system causes the display device 6 to receive the photographed image from the projection device 1, display the received photographed image on a display 61, create a drawing image DP based on a drawing operation, and transmit the created drawing image DP to the projection device 1.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a projection system and a control method for a projection system. [Background technology]

[0002] Conventionally, there are known techniques for drawing characters or the like by superimposing them on an image projected by a projection device. For example, the device disclosed in Patent Document 1 allows a user to write characters by hand and superimpose them on an image projected on a screen. This device records the handwritten character data on a recording medium in association with the projected video data, and can then play back the video data with the handwritten characters superimposed on it. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-161748 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventionally, it has not been possible to share an image, such as an image projected by a projector, and handwritten characters or the like superimposed on the image by a projector among a plurality of devices. [Means for solving the problem]

[0005] One aspect of the present disclosure is a projection system comprising a projection device and a display device, wherein the projection device comprises a PJ communication unit that communicates with the display device, a projection unit that projects an image onto a projection target, and a capture unit that captures an area including the projection target, wherein the image received from the display device by the PJ communication unit is projected by the projection unit, and the captured image generated by the capture unit is transmitted by the PJ communication unit, and the display device comprises a DP communication unit that communicates with the projection device, a display that displays an image, and an operation unit that accepts drawing operations, wherein the captured image received by the DP communication unit is displayed on the display, a drawing image is generated based on the drawing operation accepted by the operation unit while the captured image is being displayed, and the generated drawing image is transmitted by the DP communication unit.

[0006] Another aspect of the present disclosure is a projection system including a first projection device, a second projection device, and a display device, wherein the first projection device comprises a first projection unit, a first capturing unit, and a first PJ communication unit, and projects an image received from the display device by the first PJ communication unit using the first projection unit, captures an area including a projection target of the first projection unit using the first capturing unit to generate a first captured image, and transmits the first captured image via the first PJ communication unit; the second projection device comprises a second projection unit, a second capturing unit, and a second PJ communication unit, and projects an image received from the display device by the second PJ communication unit using the second projection unit, captures an area including a projection target of the second projection unit using the second capturing unit to generate a second captured image, and transmits the second captured image via the A projection system in which a second captured image is transmitted via the second PJ communication unit, and the display device comprises a display, an operation unit, and a DP communication unit, and communicates with the first projection device and the second projection device via the DP communication unit, displays the first captured image received from the first projection device in a first area of ​​the display, generates a first area drawing image based on a drawing operation corresponding to the first area received by the operation unit, transmits the first area drawing image to the first projection device, displays the second captured image received from the second projection device in a second area of ​​the display, generates a second area drawing image based on a drawing operation corresponding to the second area received by the operation unit, and transmits the second area drawing image to the second projection device.

[0007] Another aspect of the present disclosure is a projection system including a projection device, a first display device, and a second display device, wherein the first display device includes a first DP communication unit, a first display, and a first operation unit, and the first DP communication unit displays a captured image received from the projection device on the first display, generates a first DP drawing image based on a drawing operation accepted by the first operation unit while the captured image is being displayed, and transmits the generated first DP drawing image to the projection device by the first DP communication unit, and the second display device includes a second DP communication unit, a second display, and a second operation unit, and the second DP communication unit displays a captured image received from the projection device on the second display. a second DP drawing image based on a drawing operation received by the second operation unit while the captured image is being displayed, and the generated second DP drawing image is transmitted to the projection device by the second DP communication unit; the projection device comprises a PJ communication unit, a projection unit, and a capturing unit, communicates with the first display device and the second display device by the PJ communication unit, projects the first DP drawing image received from the first display device and the second DP drawing image received from the second display device by the projection unit, and transmits a captured image captured by the capturing unit of an area including the projection target onto which the first DP drawing image and the second DP drawing image are projected to the first display device and the second display device.

[0008] Another aspect of the present disclosure is a control method for a projection system including a projection device and a display device, in which the projection device receives an image from the display device, projects the received image onto a projection target, photographs an area including the projection target to generate a photographed image, and transmits the photographed image to the display device, and the display device receives the photographed image from the projection device, displays the received photographed image on a display, generates a drawing image based on a drawing operation, and transmits the generated drawing image to the projection device.

[0009] Another aspect of the present disclosure is a control method for a projection system including a first projection device, a second projection device, and a display device, wherein the first projection device comprises a first projection unit, a first capturing unit, and a first PJ communication unit, receives an image from the display device via the first PJ communication unit, projects the received image onto a projection target via the first projection unit, captures an area including the projection target of the first projection unit using the first capturing unit to generate a first captured image, and transmits the first captured image via the first PJ communication unit, and the second projection device comprises a second projection unit, a second capturing unit, and a second PJ communication unit, receives an image from the display device via the second PJ communication unit, projects the received image via the second projection unit, and captures an area including the projection target of the second projection unit using the second capturing unit to generate a second captured image. a display device including a display, an operation unit, and a DP communication unit, and communicating with the first projection device and the second projection device via the DP communication unit, displaying the first captured image received from the first projection device in a first area of ​​the display, generating a first area drawing image based on a drawing operation corresponding to the first area received by the operation unit, and transmitting the first area drawing image to the first projection device, displaying the second captured image received from the second projection device in a second area of ​​the display, generating a second area drawing image based on a drawing operation corresponding to the second area received by the operation unit, and transmitting the second area drawing image to the second projection device.

[0010] Another aspect of the present disclosure is a control method for a projection system including a projection device, a first display device, and a second display device, wherein the first display device comprises a first DP communication unit, a first display, and a first operation unit, and the first DP communication unit displays a captured image received from the projection device on the first display, generates a first DP drawing image based on a drawing operation accepted by the first operation unit while the captured image is being displayed, and transmits the generated first DP drawing image to the projection device by the first DP communication unit, and the second display device comprises a second DP communication unit, a second display, and a second operation unit, and the second DP communication unit displays the captured image received from the projection device on the second display. a second DP drawing image based on a drawing operation received by the second operation unit while the captured image is being displayed, and the generated second DP drawing image is transmitted to the projection device by the second DP communication unit; the projection device is provided with a PJ communication unit, a projection unit, and a capturing unit, communicates with the first display device and the second display device by the PJ communication unit, projects the first DP drawing image received from the first display device and the second DP drawing image received from the second display device by the projection unit, and transmits a captured image captured by the capturing unit of an area including a projection target onto which the first DP drawing image and the second DP drawing image are projected to the first display device and the second display device. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a projection system according to a first embodiment. [Figure 2] FIG. 2 is a block diagram of each device of the projection system according to the first embodiment. [Figure 3] FIG. 2 is a schematic diagram showing an example of the configuration of a projection unit and an imaging unit. [Figure 4] FIG. 10 is a schematic diagram showing another example of the configuration of the projection unit and the imaging unit. [Figure 5] FIG. 3 is a sequence diagram showing the operation of the projection system according to the first embodiment. [Figure 6]FIG. 2 is a schematic diagram illustrating the operation of the projection system according to the first embodiment. [Figure 7] FIG. 10 is a block diagram of each device of a projection system according to a second embodiment. [Figure 8] FIG. 10 is a sequence diagram showing the operation of the projection system according to the second embodiment. [Figure 9] FIG. 10 is a schematic diagram illustrating the operation of the projection system according to the second embodiment. [Figure 10] FIG. 10 is a diagram showing a schematic configuration of a projection system according to a third embodiment. [Figure 11] FIG. 10 is a block diagram of each device of a projection system according to a third embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the operation of the projection system according to the third embodiment. [Figure 13] FIG. 10 is a schematic diagram illustrating the operation of the projection system according to the third embodiment. [Figure 14] FIG. 10 is a diagram showing a schematic configuration of a projection system according to a fourth embodiment. [Figure 15] FIG. 10 is a block diagram of each device of a projection system according to a fourth embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the operation of the projection system according to the fourth embodiment. [Figure 17] FIG. 10 is a schematic diagram illustrating the operation of the projection system according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] [1. First embodiment] [1-1. Projection system configuration] 1 is a diagram showing a schematic configuration of a projection system 100 according to the first embodiment. The projection system 100 includes a projection device 1 and a display device 6. The projection device 1 and the display device 6 are connected via a communication network 3 so as to be able to communicate data with each other.

[0013] There is no limitation on the installation locations of the projection device 1 and the display device 6. For example, the use location S1 of the projection device 1 and the use location S2 of the display device 6 may be located far from each other or close to each other.

[0014] The communication network 3 is a network that enables data communication between devices. The communication network 3 may be, for example, a local network such as a LAN (Local Area Network) or a wide area network. The communication network 3 may also be, for example, an open network such as the Internet. The communication network 3 may include communication lines such as dedicated lines, public lines, or cellular communication lines, and communication devices such as routers and gateway devices. The projection device 1 and the communication network 3 may be connected by wire via a communication cable, or may be connected wirelessly by a wireless communication path. Similarly, the display device 6 and the communication network 3 may be connected by wire via a communication cable, or may be connected wirelessly by a wireless communication path. The communication cable may be, for example, a LAN cable or a USB cable conforming to the USB (Universal Serial Bus) communication standard. The wireless communication path may be, for example, Wi-Fi or Bluetooth. Wi-Fi is a registered trademark. Bluetooth is a registered trademark.

[0015] The projection device 1 projects image light PL toward the projection target OB, forming a projection image PP on the projection target OB. Projecting the image light PL by the projection device 1 corresponds to displaying the projection image PP on the projection target OB. In the following description, the term "image" includes video and still images.

[0016] FIG. 1 shows a configuration in which the projection device 1 is installed above the projection target OB and projects the image light PL downward from the projection device 1, but this is just one example. The projection target OB may be a flat surface, or a curved or uneven surface. The position of the projection device 1 and the orientation in which the projection device 1 is installed are determined depending on the positional relationship with the projection target OB. For example, the projection device 1 may be installed in an orientation in which the image light PL is projected horizontally or in an orientation in which the image light PL is projected upward.

[0017] As will be described later, the projection device 1 has a function of capturing an image of the projection target OB. The projection device 1 transmits a captured image of the projection target OB to the display device 6 via the communication network 3.

[0018] The display device 6 is a device having a display 61. The display device 6 may be any device having the display 61, an input function, and a communication function. For example, the display device 6 is configured as a tablet computer, a laptop computer, or a smartphone. The display device 6 described in this embodiment has a function of detecting an operation of a pointer 65 on the display 61 and drawing a drawn image DP based on the operation by the pointer 65. The pointer 65 is, for example, a pen-shaped device as shown in FIG. 1. The display device 6 may be configured so that the user's finger can be used as the pointer 65. Here, drawing refers to a process of generating image data of the drawn image DP based on the operation by the pointer 65 and temporarily storing the generated image data in memory.

[0019] [1-2. Configuration of Projection Device and Display Device] FIG. 2 is a block diagram of each device in the projection system 100. The projection device 1 includes a projection unit 10 that projects image light PL and a drive circuit 13 that drives the projection unit 10. The projection unit 10 includes an image light formation unit 11 and a projection optical system 12.

[0020] The image light forming unit 11 generates the image light PL. The image light forming unit 11 includes self-emitting elements that emit predetermined color light. The predetermined color light is, for example, red light, blue light, and green light. The self-emitting elements include, for example, LED (Light Emitting Diode) elements or OLED (Organic LED) elements. The configuration of the image light forming unit 11 will be described later.

[0021] The image light forming unit 11 may be configured to include, for example, a light source having a lamp or a solid-state light source, and a light modulation device that modulates the light emitted by the light source. Examples of the lamp include a halogen lamp, a xenon lamp, and an ultra-high pressure mercury lamp. Examples of the solid-state light source include an LED and a laser light source. Examples of the light modulation device include a transmissive liquid crystal panel, a reflective liquid crystal panel, and a digital micromirror device (DMD).

[0022] The projection optical system 12 includes optical elements that guide the image light PL emitted by the image light formation unit 11 toward the projection target OB. The optical elements include a single lens or a lens group including multiple lenses. The optical elements may also include a prism and a dichroic mirror.

[0023] The drive circuit 13 is connected to an image processing unit 43, which will be described later. The drive circuit 13 generates the image light PL by driving the image light formation unit 11 based on an image signal input from the image processing unit 43. For example, the drive circuit 13 causes the image light formation unit 11 to form an image on a frame-by-frame basis.

[0024] The projection device 1 includes a photographing unit 15. The photographing unit 15 is a digital camera with an image sensor. The photographing unit 15 photographs images under the control of a PJ control unit 20, which will be described later, and outputs the photographed image to the PJ control unit 20. The photographing range of the photographing unit 15 includes the direction in which the projection unit 10 projects the image light PL. For example, the photographing range of the photographing unit 15 includes the projection target OB. The image sensor included in the photographing unit 15 is, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. The configuration of the photographing unit 15 will be described later together with the configuration of the projection unit 10.

[0025] The projection device 1 includes a projection device control unit 20, an operation unit 31, a remote control receiver 32, an input interface 33, a connection unit 41, a projection device communication unit 42, and an image processing unit 43. In the following description and drawings, the projection device may be abbreviated as PJ. For example, the projection device control unit 20 will be referred to as the PJ control unit 20, and the projection device communication unit 42 will be referred to as the PJ communication unit 42. The PJ control unit 20, the input interface 33, the connection unit 41, the PJ communication unit 42, and the image processing unit 43 are connected to each other via a bus 39 so that they can communicate data with each other.

[0026] The operation unit 31 includes various buttons and switches provided on the surface of the housing of the projection device 1. The operation unit 31 generates operation signals corresponding to the operation of the buttons or switches, and outputs the signals to the input interface 33. The input interface 33 includes a circuit that outputs the operation signals input from the operation unit 31 to the PJ control unit 20.

[0027] The remote control light receiving unit 32 has a light receiving element that receives infrared light, and receives an infrared signal transmitted from the remote control 2. When a switch (not shown) provided on the remote control 2 is operated, the remote control 2 transmits an infrared signal indicating the operation. The remote control light receiving unit 32 decodes the received infrared signal to generate an operation signal. The remote control light receiving unit 32 outputs the generated operation signal to the input interface 33. The input interface 33 has a circuit that outputs the operation signal input from the remote control light receiving unit 32 to the PJ control unit 20.

[0028] There are no limitations on the specific manner in which signals are transmitted and received between the remote control 2 and the remote control light receiving unit 32. The configuration in which the remote control 2 transmits an infrared signal to the remote control light receiving unit 32 is one example. For example, the remote control 2 and the remote control light receiving unit 32 may transmit and receive signals by performing short-range wireless communication such as Bluetooth.

[0029] The connection unit 41 is an interface device that receives image data from an external device, and is connected to, for example, a player that plays back optical disc-type recording media or a personal computer.

[0030] The PJ communication unit 42 is connected to the communication network 3 and transmits and receives image data to and from the display device 6 via the communication network 3. The PJ communication unit 42 is a communication device that includes, for example, a connector for connecting a communication cable and a communication circuit for inputting and outputting signals via the communication cable. The PJ communication unit 42 may also be a wireless communication device. In this case, the PJ communication unit 42 includes, for example, an antenna, an RF (Radio Frequency) circuit, a baseband circuit, etc.

[0031] The image processing unit 43 selects an image source under the control of the PJ control unit 20. Sources available to the projection device 1 include, for example, image data received by the connection unit 41 and image data received by the PJ communication unit 42.

[0032] The image processing unit 43 performs image processing on the image data of the selected source under the control of the PJ control unit 20. The image processing performed by the image processing unit 43 includes, for example, resolution conversion processing, geometric correction processing, digital zoom processing, and image correction processing for adjusting the color tone and brightness of the image.

[0033] The image processing unit 43 generates an image signal based on the image data after image processing and outputs it to the drive circuit 13. A frame memory (not shown) may be connected to the image processing unit 43. In this case, the image processing unit 43 loads the image data acquired from the source into the frame memory. The image processing unit 43 performs image processing on the image data loaded into the frame memory.

[0034] The image processing unit 43 can be configured, for example, by an integrated circuit. The integrated circuit is configured, for example, by an LSI (Large Scale Integration). More specifically, the image processing unit 43 is configured by an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or the like. The PLD includes, for example, an FPGA (Field-Programmable Gate Array). Furthermore, an analog circuit may be included as part of the configuration of the integrated circuit, or the integrated circuit may be a combination of a processor and an integrated circuit. The combination of a processor and an integrated circuit is called a microcontroller (MCU), a SoC (System-on-a-Chip), a system LSI, a chipset, or the like.

[0035] The PJ control unit 20 includes a processor 21 and a memory 25. The memory 25 is a storage device that stores programs and data executed by the processor 21 in a nonvolatile manner. The memory 25 is configured from a magnetic storage device, a semiconductor storage element such as a flash ROM (Read Only Memory), or other types of nonvolatile storage device. The memory 25 may include a RAM (Random Access Memory) that configures the work area of ​​the processor 21. The memory 25 stores data processed by the processor 21 and a control program 26 executed by the processor 21.

[0036] The processor 21 is configured with a CPU (Central Processing Unit), an MPU (Micro-processing unit), or the like. The processor 21 may be configured with a single processor, or multiple processors functioning as the processor 21. The processor 21 may be configured as an SoC integrated with part or all of the memory 25 and / or other circuits. As described above, the processor 21 may be configured by combining a CPU that executes programs and a DSP (Digital Signal Processor) that executes predetermined arithmetic processing. All of the functions of the processor 21 may be implemented in hardware, or may be configured using a programmable device. The processor 21 may also have the functions of the image processing unit 43. In other words, the functions of the image processing unit 43 may be executed by the processor 21.

[0037] The processor 21 controls each part of the projection device 1 by executing a control program 26 stored in the memory 25 .

[0038] The processor 21 causes the image processing unit 43 to select a source and causes the image processing unit 43 to acquire image data of the selected source. The processor 21 controls the drive circuit 13 to cause the projection unit 10 to project image light PL and display an image based on the image signal output by the image processing unit 43. In the operation of the projection device 1 described below, the processor 21 causes the projection unit 10 to project an image received from the display device 6 by the PJ communication unit 42.

[0039] The processor 21 controls the image capturing unit 15 to capture an image of an area including the projection target OB. The processor 21 transmits the image captured by the image capturing unit 15 to the display device 6 via the PJ communication unit .

[0040] The display device 6 includes a display 61, a touch sensor 62, a display communication unit 63, and a display control unit 70. In the following description and drawings, the display may be abbreviated as DP. For example, the display communication unit 63 will be referred to as the DP communication unit 63, and the display control unit 70 will be referred to as the DP control unit 70.

[0041] The display 61 displays an image under the control of the DP control unit 70. The display 61 includes, for example, a liquid crystal display panel, an organic EL display panel, or another display panel.

[0042] The touch sensor 62 detects operations on the display panel of the display 61. The touch sensor 62 detects contact operations or pressure operations on the display 61 and outputs a signal indicating the operation position to the DP control unit 70. The touch sensor 62 is configured, for example, as a pressure-sensitive sensor, a resistive sensor, or a capacitance sensor. The touch sensor 62 may also be configured to detect operations by performing wireless communication with the indicator 65. The touch sensor 62 may be configured to detect operations at one position on the display panel of the display 61, or may be configured to be able to simultaneously detect operations at multiple positions on the display panel. The touch sensor 62 corresponds to an example of an operation unit.

[0043] The DP communication unit 63 is connected to the communication network 3 and transmits and receives data to and from the projection device 1 via the communication network 3. The DP communication unit 63 is, for example, a communication device including a connector for connecting a communication cable and a communication circuit for inputting and outputting signals via the communication cable. The DP communication unit 63 may also be a wireless communication device. In this case, the DP communication unit 63 includes, for example, an antenna, an RF circuit, a baseband circuit, etc.

[0044] The DP control unit 70 includes a processor 71 and a memory 75. The memory 75 is a storage device that stores programs and data executed by the processor 71 in a nonvolatile manner. The memory 75 is configured from a magnetic storage device, a semiconductor storage element such as a flash ROM, or other types of nonvolatile storage device. The memory 75 may include RAM that configures the work area of ​​the processor 71. The memory 75 stores data processed by the processor 71 and a control program 76 executed by the processor 71.

[0045] The processor 71 is configured with a CPU, an MPU, or the like. The processor 71 may be configured with a single processor, or multiple processors may function as the processor 71. The processor 71 may be configured as an SoC integrated with part or all of the memory 75 and / or other circuits. As described above, the processor 71 may also be configured with a combination of a CPU that executes programs and a DSP that executes predetermined arithmetic processing. All of the functions of the processor 71 may be implemented in hardware, or may be configured using a programmable device.

[0046] The processor 71 controls each part of the display device 6 by executing a control program 76 stored in the memory 75 .

[0047] The processor 71 causes the DP communication unit 63 to receive the captured image data transmitted by the projection device 1. The processor 71 causes the display 61 to display the captured image data received by the DP communication unit 63.

[0048] The processor 71 receives an operation detected by the touch sensor 62. The processor 71 generates a drawing image based on the received operation. The processor 71 stores the generated drawing image in the drawing image memory 77. The drawing image memory 77 is a logical or virtual storage area that uses a portion of the storage area of ​​the memory 75. The processor 71 generates a transmission image including the drawing image stored in the drawing image memory 77, and transmits the transmission image to the projection device 1 via the DP communication unit 63.

[0049] [1-3. Projection and shooting unit configuration] FIG. 3 is a schematic diagram showing an example of the configuration of the projection unit 10 and the image capture unit 15. As shown in FIG. The projection optical system 12 includes a separation optical element 121 and a projection lens 122. The optical axis of the image light PL projected by the projection lens 122 toward the projection target OB is indicated by the symbol AX. The optical axis AX is the central axis of the image light PL irradiated from the projection lens 122 onto the projection target OB, and is a virtual axis that passes through the optical center of the projection lens 122 and follows the direction in which the image light PL is irradiated from the projection lens 122.

[0050] The image light forming unit 11 includes a light emitting device 111. The light emitting device 111 has light emitting elements arranged in a row on a light emitting surface 112. The light emitting elements arranged on the light emitting surface 112 include a light emitting element that emits red light, a light emitting element that emits blue light, and a light emitting element that emits green light. By arranging these light emitting elements in a matrix, the light emitting device 111 emits image light PL that forms an image from the light emitting surface 112.

[0051] The light-emitting surface 112 faces the separation optical element 121. The image light PL emitted by the light-emitting surface 112 enters the separation optical element 121 along the optical axis AX, passes through the separation optical element 121, and enters the projection lens 122. The projection lens 122 irradiates the image light PL that has passed through the separation optical element 121 onto the projection target OB. The optical axis of the image light PL emitted by the light-emitting surface 112 is defined as the projection optical axis PAX. The projection optical axis PAX is the central axis of the image light PL emitted by the light-emitting device 111, and is a virtual axis that passes through the center of the area in which the light-emitting elements are arranged on the light-emitting surface 112 and is perpendicular to the light-emitting surface 112. In the configuration of FIG. 3 , the projection optical axis PAX coincides with the optical axis AX. In other words, the light-emitting device 111 is arranged on the optical axis AX of the projection optical system 12.

[0052] The photographing unit 15 includes an imaging device 151. The imaging device 151 is disposed opposite the separation optical element 121. In the imaging device 151, imaging elements are disposed side by side on an imaging surface 152 facing the separation optical element 121. The photographing unit 15 photographs an image by each imaging element disposed on the imaging surface 152 receiving light incident from the separation optical element 121. The imaging device 151 faces a surface of the separation optical element 121 different from the surface of the light-emitting device 111. In detail, the light-emitting device 111 is disposed so as to be aligned with the separation optical element 121 in a direction along the optical axis AX. In contrast, the imaging device 151 faces the separation optical element 121 at an angle of 90 degrees with respect to the optical axis AX.

[0053] The separation optical element 121 transmits light emitted by the light emitting device 111 and causes it to enter the projection lens 122, while reflecting light that has entered the separation optical element 121 from the projection lens 122 toward the imaging device 151. The separation optical element 121 may be, for example, a polarization separation element. The separation optical element 121 may also be configured with a dichroic mirror or a dichroic prism.

[0054] The optical axis of light reflected by the separation optical element 121 toward the imaging device 151 is indicated by the symbol IAX. The imaging optical axis IAX is the central axis of light traveling from the separation optical element 121 toward the imaging device 151, and is the axis of light received by the imaging device 151 on the imaging surface 152. The imaging optical axis IAX is a virtual axis perpendicular to the imaging surface 152. In other words, the imaging device 151 is positioned so that the center of the imaging surface 152 coincides with the imaging optical axis IAX.

[0055] The photographing optical axis IAX coincides with the optical axis AX until it is reflected inside the separation optical element 121 . That is, in an area closer to the projection target OB than the projection optical system 12, the projection optical axis PAX of the image light PL emitted by the image light formation unit 11 coincides with the imaging optical axis IAX of the light received by the imaging unit 15. In this way, the projection unit 10 and the imaging unit 15 are optically arranged on the same axis. That is, the projection unit 10 and the imaging unit 15 project and capture the image light PL on the same axis.

[0056] 3 is a schematic diagram, and the projection unit 10, the projection optical system 12, and the imaging unit 15 may include components not shown in Fig. 3. For example, the projection optical system 12 may include optical elements other than the separation optical element 121 and the projection lens 122. For example, the projection optical system 12 may include a light guiding element between the separation optical element 121 and the projection lens 122. A polarization separation element and a polarization conversion element may be provided between the light emitting device 111 and the separation optical element 121 to adjust the polarization of the image light PL incident on the separation optical element 121.

[0057] FIG. 4 is a schematic diagram showing another example of the configuration of the projection unit 10 and the image capture unit 15. In FIG. This configuration example uses a light receiving and emitting device 14 that integrates the projection unit 10 and the image capturing unit 15. In the example of Fig. 4, the projection optical system 12 does not have a separation optical element 121. The projection lens 122 in Fig. 4 may be the same as the projection lens 122 illustrated in Fig. 3, or may have a different configuration.

[0058] The light emitting and receiving device 14 is disposed on the optical axis AX of the projection lens 122. The light emitting and receiving device 14 includes a light emitting element and a light receiving element on a light emitting and receiving surface 14a facing the projection lens 122. That is, as shown enlarged in circle A in Fig. 4, a blue light emitting element 141, a red light emitting element 142, a green light emitting element 143, and an imaging element 145 are disposed on the light emitting and receiving surface 14a.

[0059] The blue light-emitting element 141, the red light-emitting element 142, and the green light-emitting element 143 are configured, for example, by LEDs or OLEDs. The blue light-emitting element 141 is an element that emits light in a blue wavelength region, the red light-emitting element 142 is an element that emits light in a red wavelength region, and the green light-emitting element 143 is an element that emits light in a green wavelength region. In the example of FIG. 4, one pixel region 140 is configured by two blue light-emitting elements 141, one red light-emitting element 142, and one green light-emitting element 143. The pixel region 140 is an area that forms one pixel included in an image formed by the light-receiving and light-emitting device 14. The pixel region 140 forms the color of one pixel by two blue light-emitting elements 141, one red light-emitting element 142, and one green light-emitting element 143.

[0060] The light receiving and emitting surface 14a includes one image sensor 145 per pixel region 140. The image sensor 145 is an element made of a CMOS or a CCD, and receives light incident on the light receiving and emitting surface 14a. The photographing unit 15 photographs an image by receiving light with the image sensor 145.

[0061] In this way, the light receiving and emitting device 14 functions as an image light forming unit 11 that forms image light PL, and as an imaging unit 15 that captures images. The optical axis of the image light PL emitted by the light receiving and emitting device 14 is optical axis AX, and the imaging unit 15 captures images using light that is incident along the optical axis AX. In the configuration of Fig. 4, similar to the configuration shown in Fig. 3, the projection unit 10 and the imaging unit 15 are optically arranged on the same axis, and the projection unit 10 and the imaging unit 15 project and capture images along the same axis.

[0062] [1-4. Projection System Operation] Fig. 5 is a sequence diagram showing the operation of the projection system 100. Fig. 6 is a schematic diagram showing the operation of the projection system 100. The operation of the projection system 100 will be described with reference to these figures.

[0063] In FIG. 5, the processes of steps SA11 to SA15 are executed by the PJ control unit 20, and the processes of steps SB11 to SB18 are executed by the DP control unit .

[0064] In step SA11, the projection device 1 captures an image of an area including the projection target OB. In step SA12, the projection device 1 transmits the captured image to the display device 6.

[0065] In step SB11, the display device 6 receives the captured image transmitted by the projection device 1. The display device 6 displays the received captured image on the display 61 in step SB12.

[0066] Here, when the display device 6 detects an operation by the indicator 65, it accepts this operation in step SB13. In step SB14, the display device 6 generates a drawn image based on the operation accepted in step SB13. For example, the display device 6 draws a curved line or a straight line along the trajectory of the movement of the indicator 65.

[0067] In step SB15, based on the drawn image generated in step SB14, display device 6 updates the image stored in drawn image memory 77. For example, display device 6 overlays the drawn image generated in step SB14 on the drawn image stored in drawn image memory 77 to synthesize the image, and stores the synthesized image in drawn image memory 77.

[0068] In step SB16, the display device 6 displays the drawn image generated in step SB14 on the display 61. Specifically, the display device 6 generates a composite image by overlaying the drawn image generated in step SB14 on the photographed image displayed in step SB12, and displays the composite image on the display 61.

[0069] In step SB17, the display device 6 transmits the image in the updated drawing image memory 77 to the projection device 1. In step SA13, the projection device 1 receives the image transmitted by the display device 6. In step SA14, the projection device 1 projects the received image onto the projection target OB using the projection unit 10.

[0070] In step SA15, the projection device 1 determines whether to end the operation. If the projection device 1 determines to end the operation (step SA15; YES), such as when an operation instructing to end the operation is detected by the input interface 33, the projection device 1 ends this process. If the projection device 1 determines not to end the operation (step SA15; NO), the projection device 1 returns to step SA11.

[0071] After transmitting the image to the projection device 1, the display device 6 determines whether to end the operation in step SB18. If the display device 6 determines to end the operation (step SB18; YES), such as when an operation instructing to end the operation is detected by the touch sensor 62, the display device 6 ends this process. If the display device 6 determines not to end the operation (step SB18; NO), the process returns to step SB11.

[0072] FIG. 6 shows the operating states ST1, ST2, ST3, and ST4 of the projection system 100. An object OB2 is placed on a plane OB1 as a projection target OB of the projection device 1. Paper or the like is placed on the plane OB1, and a user of the projection device 1 can write letters or figures on the plane OB1 with a writing implement such as a pencil.

[0073] In state ST1, the projection device 1 captures an image of a plane OB1 and an object OB2 to generate a captured image. The projection device 1 transmits the generated captured image as a first image P1 to the display device 6. The first image P1 includes an object image OP1, which is a captured image of the object OB2. The display device 6 receives the first image P1 and displays the first image P1 on the display 61. The object image OP1 is displayed on the display 61.

[0074] State ST2 is a state in which an operation is performed on the display device 6 by the indicator 65. The display device 6 draws a first drawn image DP1 based on the operation of the indicator 65. As described with reference to FIG. 5, the display device 6 stores the first drawn image DP1 in the drawn image memory 77. The display device 6 transmits a second image P2 including the first drawn image DP1 as a transmitted image to the projection device 1. The projection device 1 receives the second image P2 and projects the second image P2 onto the projection target OB.

[0075] State ST3 is a state in which a figure is written on flat surface OB1 with a writing implement in projection device 1. Projection device 1 captures an image of projection target OB to generate a captured image, and transmits the generated captured image to display device 6 as third image P3. Third image P3 includes object image OP1, which is an image of object OB2, object image OP2, and object image OP3. Object image OP2 is an image captured by imaging unit 15 of first drawn image DP1 projected by projection unit 10 onto projection target OB. Object image OP3 is an image captured by imaging unit 15 of the figure written on flat surface OB1 with a writing implement in projection device 1.

[0076] The display device 6 receives the third image P3 and displays the third image P3 on the display 61. The display 61 displays the object images OP1, OP2, and OP3 included in the third image P3. When displaying the third image P3, the display device 6 switches the previous display to the third image P3. As a result, the display of the first drawn image DP1 displayed in state ST2 is stopped.

[0077] State ST4 is a state in which an operation is performed on the display device 6 using the pointer 65. The display device 6 draws a second drawn image DP2 based on the operation of the pointer 65. As described with reference to FIG. 5, the display device 6 updates the image in the drawn image memory 77 based on the second drawn image DP2. As a result, a composite image obtained by combining the first drawn image DP1 and the second drawn image DP2 is stored in the drawn image memory 77. That is, the image stored in the updated second image memory 77 includes the first drawn image DP1 and the second drawn image DP2. The display device 6 transmits a fourth image P4, which includes the image stored in the updated drawn image memory 77, to the projection device 1 as a transmitted image. The fourth image P4 includes the first drawn image DP1 and the second drawn image DP2. The projection device 1 receives the fourth image P4 and projects the fourth image P4 onto the projection target OB using the projection unit 10.

[0078] The first image P1 is an image captured and transmitted by the projection device 1, and is an image received by the display device 6. The second image P2 is an image transmitted by the display device 6, and is an image received and projected by the projection device 1. The third image P3 is an image captured and transmitted by the projection device 1, and is an image received by the display device 6, and the fourth image P4 is an image transmitted by the display device 6, and is an image received and projected by the projection device 1. The first drawn image DP1 and the second drawn image DP2 are drawn images generated on the display device 6 based on the operation of the pointer 65.

[0079] 6 is characterized in that the display device 6 displays the first image P1 and the third image P3, which are images captured by the projection device 1. Moreover, the projection device 1 does not display the first image P1 and the third image P3, which are images captured by the projection device 1. For example, in state ST3, if the display device 6 displays the first image P3, which is an image captured by the projection device 1, on the display 61 while the first drawn image DP1 is still displayed on the display 61, the object image OP2 and the first drawn image DP1 will be displayed superimposed in the same position. If the object image OP2 and the first drawn image DP1 differ in position, shape, and size, the difference between the object image OP2 and the first drawn image DP1 may cause the display on the display 61 to be distorted. For example, the lines constituting the object image OP2 and the lines constituting the first drawn image DP1 may be displayed as double lines. Furthermore, for example, the lines constituting the object image OP2 and the lines constituting the first drawn image DP1 may be displayed as interference fringes. Such displays result in a decrease in display quality and are a factor in reducing the visibility of the object image OP2 and the first drawn image DP1.

[0080] In particular, when the projection optical axis PAX of the projection unit 10 and the imaging optical axis IAX of the imaging unit 15 are coaxial, as shown in Figures 3 and 4, the difference in position and size between the object image OP2 and the first drawn image DP1 is very small. However, there is a high possibility that the object image OP2 and the first drawn image DP1 will not completely match in position, shape, and size. This may be due to factors such as changes in the brightness of the ambient light around the projection device 1 and differences in resolution between the image projected by the projection unit 10 and the image captured by the imaging unit 15. This may result in a phenomenon in which the lines constituting the object image OP2 and the lines constituting the first drawn image DP1 are displayed like interference fringes.

[0081] In this embodiment, when the display device 6 generates the first drawing image DP1 based on the operation of the pointer 65, after transmitting the second image P2 including the first drawing image DP1 to the projection device 1, the display device 6 does not display the first drawing image DP1 on the display 61. Specifically, after receiving the third image P3 including the object image OP2 corresponding to the first drawing image DP1, the display device 6 does not display the first drawing image DP1 on the display 61. The same applies to the second drawing image DP2. As a result, the first drawing image DP1 and the object image OP2 corresponding to the first drawing image DP1 are not displayed overlapping each other. Therefore, a decrease in the display quality of the image displayed on the display 61 can be prevented.

[0082] Then, the display device 6 stores the first drawn image DP1 and the second drawn image DP2 in the drawn image memory 77. Therefore, the first drawn image DP1 and the second drawn image DP2, which are multiple drawn images generated at different times, can be projected by the projection device 1. This has the advantage that the drawn images drawn by the user of the display device 6 will not be lost.

[0083] [1-5. Operation of the embodiment] As described above, the projection system 100 described in the first embodiment includes the projection device 1 and the display device 6. The projection device 1 includes a PJ communication unit 42 that communicates with the display device 6, a projection unit 10 that projects an image onto the projection target OB, and a capture unit 15 that captures an area including the projection target OB. The projection device 1 projects an image received by the PJ communication unit 42 using the projection unit 10, and transmits a captured image generated by the capture unit 15 via the PJ communication unit 42. The display device 6 includes a DP communication unit 63 that communicates with the projection device 1, a display 61 that displays an image, and a touch sensor 62 that accepts drawing operations. The display device 6 displays the captured image received by the DP communication unit 63 on the display, and generates a drawing image based on a drawing operation accepted by the touch sensor 62 while the captured image is being displayed. The display device 6 transmits the generated drawing image via the DP communication unit 63.

[0084] A control method for a projection system 100 including a projection device 1 and a display device 6 includes having the projection device 1 receive an image from the display device 6, project the received image onto the projection target OB, capture an image of an area including the projection target OB, and transmit the captured image to the display device 6. This control method includes having the display device 6 receive the captured image from the projection device 1, display the received captured image on a display 61, generate a drawing image based on a drawing operation, and transmit the generated drawing image to the projection device 1.

[0085] This allows the state of the projection target OB of the projection device 1 to be displayed by the display device 6, and allows the projection device 1 to project an image drawn based on the operation of the display device 6. Therefore, the user of the projection device 1 and the user of the display device 6 can share the state of the projection target OB of the projection device 1 and the content of the drawing operation on the display device 6.

[0086] In the projection system 100, the display device 6 includes a drawing image memory 77 that stores a drawing image. The display device 6 updates the drawing image stored in the drawing image memory 77 based on a drawing operation received by the touch sensor 62, and transmits the updated drawing image to the projection device 1. This allows the display device 6 to transmit multiple drawn images DP1 and DP2 generated based on the operation of the pointer 65 at different times to the projection device 1. This eliminates the need to continue displaying the drawn image DP1. This prevents a decrease in display quality caused by the drawn image and the captured image corresponding to the drawn image overlapping, and allows the drawn images drawn through multiple operations to be shared between the projection device 1 and the display device 6.

[0087] [2. Second Embodiment] FIG. 7 is a block diagram of each device of the projection system 100A of the second embodiment. FIG. 8 is a sequence diagram showing the operation of the projection system 100A of the second embodiment. FIG. 9 is a schematic diagram showing the operation of the projection system 100A of the second embodiment. The second embodiment will be described with reference to these figures. In the description of the second embodiment, the components of the projection system 100A that are common to the first embodiment are given the same reference numerals, and their description will be omitted. Furthermore, the operations of the projection system 100A that are common to the first embodiment are given the same step numbers, and their description will be omitted.

[0088] The projection system 100A is composed of a projection device 1A and a display device 6A. The projection device 1A has a configuration in common with the projection device 1 described in the first embodiment, but differs in that a received image memory 27 is provided in the memory 25. The display device 6 has a configuration in common with the display device 6, but differs from the display device 6 in that a drawn image memory 77 is not provided in the memory 75.

[0089] The received image memory 27 is a logical or virtual storage area that is provided using part of the storage area of ​​the memory 25. The PJ control unit 20 stores the image received from the display device 6A via the PJ communication unit 42 in the received image memory 27. Every time the PJ control unit 20 receives an image from the display device 6A, it combines the received image with the image stored in the received image memory 27 to update the image stored in the received image memory 27. The PJ control unit 20 causes the projection unit 10 to project the image stored in the received image memory 27.

[0090] On the other hand, the display device 6A does not have a configuration equivalent to the drawn image memory 77 of the display device 6. Therefore, the display device 6A transmits a drawn image to the projection device 1A every time the display device 6A generates a drawn image based on an operation detected by the touch sensor 62.

[0091] Fig. 8 is a sequence diagram showing the operation of the projection system 100. Fig. 9 is a schematic diagram showing the operation of the projection system 100. The operation of the projection system 100 will be described with reference to these figures.

[0092] 8, the processes of steps SA11, SA12, SA13, SA15, SA21, and SA22 are executed by the PJ control unit 20, and the processes of steps SB11 to SB14, SB18, SB21, and SB22 are executed by the DP control unit 70. Of these, the operations of steps SA11 to SA13, SA15, and steps SB11 to SB14, and SB18 are the same as those described in the first embodiment, and therefore detailed description thereof will be omitted.

[0093] The projection device 1A captures an image of the projection target OB in step SA11, and transmits the captured image to the display device 6A in step SA12. The display device 6A receives the captured image in step SB11, and displays the received captured image on the display 61 in step SB12. If the display device 6A receives an operation using the indicator 65 in step SB13, it generates a drawn image based on the operation in step SB14.

[0094] Subsequently, in step SB21, the display device 6A displays the drawn image generated in step SB14 on the display 61. In step SB21, the display device 6A displays the drawn image on the captured image being displayed on the display 61 in an overlapping manner.

[0095] Furthermore, in step SB22, the display device 6A transmits the drawn image generated in step SB14 to the projection device 1A, and proceeds to step SB18.

[0096] In step SA13, projection device 1A receives an image from display device 6A. Projection device 1A proceeds to step SA21 and updates the image in received image memory 27 based on the received image. In detail, projection device 1A generates a composite image by combining the image received in step SA13 with the image stored in received image memory 27. Projection device 1A updates the image in received image memory 27 by storing the composite image in received image memory 27.

[0097] The projection device 1A proceeds to step SA22, where it causes the projection unit 10 to project the image in the updated received image memory 27 onto the projection target OB, and then proceeds to step SA15.

[0098] 9 shows operating states ST1, ST2, ST3, and ST4 of the projection system 100A. As in the first embodiment, the projection target OB of the projection device 1A is configured as a plane OB1, and an object OB2 is placed thereon.

[0099] In state ST1, the projection device 1A captures an image of a plane OB1 and an object OB2 to generate a captured image, and transmits the first image P1 to the display device 6A. The first image P1 includes an object image OP1, which is a captured image of the object OB2. The display device 6A receives the first image P1 and displays the first image P1 on the display 61. The object image OP1 is displayed on the display 61.

[0100] State ST2 is a state in which an operation is performed on display device 6A by pointer 65. Display device 6A draws a first drawn image DP1 based on the operation of pointer 65. Display device 6A displays first drawn image DP1 on display 61, and transmits a second image P2 including first drawn image DP1 to projection device 1A as a transmitted image.

[0101] The projection device 1A receives the second image P2. The projection device 1A stores the second image P2 in the received image memory 27. If an image is already stored in the received image memory 27, the projection device 1A updates the image stored in the received image memory 27.

[0102] State ST3 is a state in which a figure is written on flat surface OB1 with a writing implement in projection device 1A. Projection device 1A captures an image of projection target OB and transmits a third image P3 to display device 6A. The third image P3 includes object image OP1, which is an image of object OB2, object image OP2, and object image OP3. Object image OP2 is an image captured by imaging unit 15 of a first drawn image DP1 projected onto projection target OB by projection unit 10. Object image OP3 is an image captured by imaging unit 15 of the figure written on flat surface OB1 with a writing implement in projection device 1A.

[0103] The display device 6A receives the third image P3 and displays the third image P3 on the display 61. The display 61 displays the object images OP1, OP2, and OP3 included in the third image P3. When displaying the third image P3, the display device 6A switches the previous display to the third image P3. As a result, the display of the first drawn image DP1 displayed in state ST2 is stopped.

[0104] State ST4 is a state in which an operation is performed on display device 6A by pointer 65. Display device 6A draws a second drawn image DP2 based on the operation of pointer 65. Display device 6A transmits a fourth image P5 including second drawn image DP2 to projection device 1A as a transmitted image.

[0105] The projection device 1A receives the fourth image P5 and updates the image stored in the received image memory 27 based on the fourth image P5. As a result, the image stored in the received image memory 27 is updated to an image in which the first drawn image DP1 and the second drawn image DP2 are superimposed. The projection device 1A projects the image stored in the received image memory 27 onto the projection target OB. As a result, the first drawn image DP1 and the second drawn image DP2 are projected onto the projection target OB.

[0106] The first image P1 is an image captured and transmitted by the projection device 1A and an image received by the display device 6A. The second image P2 is an image transmitted by the display device 6A and an image received and projected by the projection device 1A. The third image P3 is an image captured and transmitted by the projection device 1A and an image received by the display device 6A. The fourth image P5 is an image transmitted by the display device 6A and an image received and projected by the projection device 1A. The first drawn image DP1 and the second drawn image DP2 are drawn images generated on the display device 6A based on the operation of the pointer 65.

[0107] As described above, in the projection system 100A described in the second embodiment, the projection device 1A includes a received image memory 27 that stores an image received by the PJ communication unit 42. The projection device 1A updates the image stored in the received image memory 27 based on the image received by the PJ communication unit 42, and projects the updated image in the received image memory 27 by the projection unit 10. The projection device 1A does not display the first image P1 and the third image P3, which are captured images.

[0108] According to the projection system 100A of the second embodiment, the state of the projection target OB of the projection device 1A can be displayed by the display device 6A, and an image drawn based on the operation of the display device 6A can be projected by the projection device 1A. Therefore, a user of the projection device 1A and a user of the display device 6A can share the state of the projection target OB of the projection device 1A and the content of the drawing operation performed on the display device 6A. Furthermore, according to the projection system 100A, the projection device 1A can store multiple drawing images DP1 and DP2 generated by the display device 6A at different times in the received image memory 27. Therefore, even if the display device 6A does not have the function to store the drawing images DP1 and DP2, the projection device 1A can project the multiple drawing images DP1 and DP2 generated at different times. This prevents a degradation in display quality caused by overlapping of the drawing images with the captured images corresponding to the drawing images, and allows drawing images drawn through multiple operations to be shared between the projection device 1A and the display device 6A.

[0109] 3. Third Embodiment FIG. 10 is a diagram showing a schematic configuration of a projection system 100B of the third embodiment. FIG. 11 is a block diagram of each device of the projection system 100B of the third embodiment. FIG. 12 is a sequence diagram showing the operation of the projection system 100B of the third embodiment. FIG. 13 is a schematic diagram showing the operation of the projection system 100B of the third embodiment. The third embodiment will be described with reference to these figures. In the description of the third embodiment, components of the projection system 100B that are common to the first or second embodiment are assigned the same reference numerals, and descriptions thereof will be omitted. Furthermore, operations of the projection system 100B that are common to the first or second embodiment are assigned the same step numbers, and descriptions thereof will be omitted.

[0110] As shown in Fig. 10, projection system 100B includes projection devices 1B and 1C, and a display device 6B. Projection devices 1B and 1C, and display device 6B are each connected to a communication network 3. Projection devices 1B, 1C, and display device 6B are connected to each other so that they can communicate data with each other via communication network 3. Projection device 1B corresponds to an example of a first projection device, and projection device 1C corresponds to an example of a second projection device.

[0111] Projection device 1B is installed at usage location S1, and projection device 1C is installed at usage location S3. Furthermore, display device 6B is installed at usage location S2. There are no restrictions on usage locations S1, S2, and S3, and they may be located far from each other or close to each other.

[0112] Projection device 1B has the same configuration as projection device 1 described in the first embodiment. Projection device 1C has the same configuration. As shown in FIG. 11, projection devices 1B and 1C have configurations corresponding to the projection unit 10, image capture unit 15, PJ control unit 20, and PJ communication unit 42 of projection device 1. In this embodiment, to distinguish the configuration, the projection unit 10 provided in projection device 1B is referred to as a first projection unit 10B. Similarly, the image capture unit 15, PJ control unit 20, and PJ communication unit 42 provided in projection device 1B are referred to as a first image capture unit 15B, a first PJ control unit 20B, and a first PJ communication unit 42B, respectively. Furthermore, the projection unit 10, the photographing unit 15, the PJ control unit 20, and the PJ communication unit 42 included in the projection device 1C are respectively referred to as a second projection unit 10C, a second photographing unit 15C, a second PJ control unit 20C, and a second PJ communication unit 42C. These configurations are as described in the first embodiment.

[0113] Like the display device 6 described in the first embodiment, the display device 6B has a display 61, a touch sensor 62, a DP communication unit 63, and a DP control unit 70. The display device 6 differs from the display device 6A in that the display device 6A has a first drawn image memory 78 and a second drawn image memory 79 in the memory 75. The first drawn image memory 78 and the second drawn image memory 79 are logical or virtual memory areas that use part of the memory area of ​​the memory 75.

[0114] 10, display device 6B has two display areas 611 and 612 on display 61. Display device 6B displays different images in display area 611 and display area 612. In this embodiment, display area 611 is a display area corresponding to projection device 1B, and display area 612 is a display area corresponding to projection device 1C. Display area 611 corresponds to an example of a first area, and display area 612 corresponds to an example of a second area.

[0115] Projection device 1B uses first image capturing unit 15B to capture an image of a capture range including projection target OB of projection device 1B. Projection device 1B transmits the image captured by first image capturing unit 15B to display device 6B. Projection device 1C uses second image capturing unit 15C to capture an image of a capture range including projection target OB of projection device 1C and transmits the captured image to display device 6B.

[0116] The display device 6B displays the captured image received from the projection device 1B in a display area 611, and displays the captured image received from the projection device 1C in a display area 612.

[0117] Display area 611 is an operation area corresponding to projection device 1B, and display area 612 is an operation area corresponding to projection device 1C. When display device 6B receives an operation on display area 611 by pointer 65 or the like, it generates a drawn image DP corresponding to projection device 1B based on the operation. In this case, display device 6B transmits an image including the drawn image DP to projection device 1B. When display device 6B receives an operation on display area 612 by pointer 65 or the like, it generates a drawn image DP corresponding to projection device 1C based on the operation. In this case, display device 6B transmits an image including the drawn image DP to projection device 1C. Projection device 1B projects the image received from display device 6B onto projection target OB using first projection unit 10B. Projection device 1C projects the image received from display device 6B onto projection target OB using second projection unit 10C.

[0118] The operation of the projection system 100B will be described with reference to FIG. 12, the processes of steps SA11 to SA15 are executed by the first PJ control unit 20B and the second PJ control unit 20C, respectively. The processes of steps SB11, SB13, SB14, SB18, and SB31 to SA35 are executed by the DP control unit 70. The operations of steps SA11 to SA15 and steps SB11, SB13, SB14, and SB18 are the same as those described in the first embodiment, and therefore detailed description thereof will be omitted.

[0119] The projection device 1B captures an image of the projection target OB in step SA11, and transmits the captured image to the display device 6B in step SA12.

[0120] Display device 6B receives the captured image in step SB11. In step SB31, display device 6B displays the captured image received in step SB11 in display area 611 or display area 612. That is, display device 6B displays the image received from projection device 1B in step SB11 in display area 611, and displays the image received from projection device 1C in display area 612.

[0121] When the display device 6B receives the operation by the indicator 65 in step SB13, the display device 6B generates a drawn image based on the operation in step SB14.

[0122] Subsequently, in step SB32, display device 6B identifies the area corresponding to the drawn image generated in step SB14. That is, display device 6B identifies whether the drawn image generated in step SB14 corresponds to display area 611 or display area 612.

[0123] In step SB33, the display device 6B updates either the image in the first drawn image memory 78 or the second drawn image memory 79 based on the image generated in step SB14. Specifically, if the image generated in step SB14 is an image generated based on an operation on the display area 611, the display device 6B updates the image stored in the first drawn image memory 78. In this case, the display device 6B generates a composite image by combining the image generated in step SB14 with the image stored in the first drawn image memory 78. The display device 6B updates the image stored in the first drawn image memory 78 with the composite image. Furthermore, if the image generated in step SB14 is an image generated based on an operation on the display area 612, the display device 6B updates the image stored in the second drawn image memory 79. In this case, the display device 6B generates a composite image by combining the image generated in step SB14 with the image stored in the second drawn image memory 79. The display device 6B updates the image stored in the second drawn image memory 79 with the composite image.

[0124] In step SB34, display device 6B displays the drawing image on display 61 based on the determination result of step SB32. In step SB34, display device 6B displays the drawing image generated based on the operation on display area 611 in display area 611, and displays the drawing image generated based on the operation on display area 612 in display area 612. In step SB34, display device 6B may display the drawing image superimposed on the captured image already being displayed on display 61.

[0125] In step SB35, the display device 6B performs at least one of an operation of transmitting the image stored in the first drawn image memory 78 to the projection device 1B and an operation of transmitting the image stored in the second drawn image memory 79 to the projection device 1C. In detail, if the image stored in the first drawn image memory 78 is updated in step SB33, the display device 6B transmits the image to the projection device 1B in step SB35. If the image stored in the second drawn image memory 79 is updated in step SB33, the display device 6B transmits the image to the projection device 1C in step SB35. Thereafter, the display device 6B proceeds to step SB18.

[0126] In step SA13, projection device 1B receives the image from display device 6B, projects the received image using first projection unit 10B in step SA14, and then proceeds to step SA15.

[0127] The projection device 1C captures an image of the projection target OB in step SA11 and transmits the captured image to the display device 6B in step SA12. The projection device 1C receives an image from the display device 6B in step SA13, projects the received image by the second projection unit 10C in step SA14, and then proceeds to step SA15.

[0128] 13 shows operating states ST1 and ST2 of the projection system 100B. The projection target OB of the projection devices 1B and 1C is formed of a plane OB1, and an object OB2 is placed thereon, which is the same as the projection device 1 described in the first embodiment.

[0129] In state ST1, the projection device 1B captures an image of the plane OB1 and the object OB2 to generate a captured image, and transmits a first captured image P11 to the display device 6B. The first captured image P11 includes an object image OP11 that is a captured image of the object OB2. The projection device 1C captures an image of the plane OB1 and the object OB2 to generate a captured image, and transmits a second captured image P21 to the display device 6B. The second captured image P21 includes an object image OP21 that is a captured image of the object OB4 placed on the projection target OB of the projection device 1C. The first captured image P11 corresponds to an example of a captured image generated by the projection device 1B, and the second captured image P21 corresponds to an example of a captured image generated by the projection device 1C.

[0130] The display device 6B receives the first captured image P11 and displays the first captured image P11 in the display area 611 of the display 61. The display device 6B also receives the second captured image P21 and displays the second captured image P21 in the display area 612. On the display 61, an object image OP11 that is an image of the object OB2 is displayed in the display area 611, and an object image OP21 that is an image of the object OB4 is displayed in the display area 612.

[0131] State ST2 is a state in which an operation is performed on the display device 6B using the indicator 65. The display device 6B draws a first region drawing image DP11 based on the operation on the display area 611. The display device 6B generates a first transmission image P12 including the first region drawing image DP11 and transmits the first transmission image P12 to the projection device 1B. The display device 6B also draws a second region drawing image DP21 based on the operation on the display area 612. The display device 6B generates a second transmission image P22 including the second region drawing image DP21 and transmits the transmission image P22 to the projection device 1C. The first region drawing image DP11 corresponds to an example of a drawing image in the display area 611 of the display device 6B, and the second region drawing image DP21 of the display device 6B corresponds to an example of a drawing image in the display area 612. Furthermore, the first transmitted image P12 corresponds to an example of a transmitted image transmitted from the display device 6B to the projection device 1B, and the second transmitted image P22 corresponds to an example of a transmitted image transmitted from the display device 6B to the projection device 1C.

[0132] The projection device 1B receives the first transmission image P12 and projects the first transmission image P12 using the first projection unit 10B. The projection device 1C receives the second transmission image P22 and projects the second transmission image P22 using the second projection unit 10C.

[0133] In state ST2, the display device 6B updates the image stored in the first drawn image memory 78 based on the first region drawn image DP11, and updates the image stored in the second drawn image memory 79 based on the second region drawn image DP21.

[0134] As described above, the projection system 100B described in the third embodiment is a system including a projection device 1B, a projection device 1C, and a display device 6B. The projection device 1B includes a first projection unit 10B, a first image capturing unit 15B, and a first PJ communication unit 42B. The projection device 1B projects an image received from the display device 6B by the first PJ communication unit 42B using the first projection unit 10B. The projection device 1B captures an area including the projection target OB of the first projection unit 10B using the first image capturing unit 15B to generate a first captured image, and transmits the first captured image via the first PJ communication unit 42B. The projection device 1C includes a second projection unit 10C, a second image capturing unit 15C, and a second PJ communication unit 42C. The projection device 1C projects the image received from the display device 6B via the second PJ communication unit 42C using the second projection unit 10C. The projection device 1C captures an area including the projection target OB of the second projection unit 10C using the second capture unit 15C to generate a second captured image, and transmits the second captured image via the second PJ communication unit 42C. The display device 6B includes a display 61, a touch sensor 62, and a DP communication unit 63. The display device 6B communicates with the projection device 1B and the projection device 1C via the DP communication unit 63. The display device 6B displays the first captured image received from the projection device 1B in a display area 611 of the display 61. The display device 6B generates a first region drawing image based on the drawing operation corresponding to the display area 611 received by the touch sensor 62, and transmits the first region drawing image to the projection device 1B. The display device 6B displays the second captured image received from the projection device 1C in the display area 612 of the display 61. The display device 6B generates a second region drawing image based on the drawing operation corresponding to the display area 612 received by the touch sensor 62, and transmits the second region drawing image to the projection device 1C.

[0135] In the control method for projection system 100B, projection device 1B receives an image from display device 6B via first PJ communication unit 42B and projects the received image onto projection target OB via first projection unit 10B. Projection device 1B generates a first captured image by capturing an area including projection target OB by first projection unit 10B via first capture unit 15B and transmits the first captured image via first PJ communication unit 42B. Projection device 1C receives an image from display device 6B via second PJ communication unit 42C and projects the image received from display device 6B via second PJ communication unit 42C via second projection unit 10C. Projection device 1C captures an area including projection target OB by second projection unit 10C via second capture unit 15C to generate a second captured image and transmits the second captured image via second PJ communication unit 42C. The display device 6B communicates with the projection device 1B and the projection device 1C via the DP communication unit 63, and displays the first captured image received from the projection device 1B in the display area 611 of the display 61. The display device 6B generates a first region drawing image based on the drawing operation corresponding to the display area 611 received by the touch sensor 62, and transmits the first region drawing image to the projection device 1B. The display device 6B displays the second captured image received from the projection device 1C in the display area 612 of the display 61, generates a second region drawing image based on the drawing operation corresponding to the display area 612 received by the touch sensor 62, and transmits the second region drawing image to the projection device 1C.

[0136] This allows the state of the projection target OB of the projection devices 1B and 1C to be displayed by the display device 6B, and allows the projection devices 1B and 1C to project images drawn based on the operation of the display device 6B. Therefore, the users of the projection devices 1B and 1C and the users of the display device 6B can share the state of the projection target OB of the projection devices 1B and 1C and the content of the drawing operation on the display device 6B.

[0137] Furthermore, projection device 1B shares with display device 6B a drawn image generated by an operation on display area 611 on display device 6B. On the other hand, projection device 1C shares with display device 6B a drawn image generated by an operation on display area 612 on display device 6B. In this way, one display device 6B can individually share an image with a plurality of projection devices 1B and 1C.

[0138] The display device 6B includes a first drawing image memory 78 that stores a first drawing image and a second drawing image memory 79 that stores a second drawing image. The display device 6B updates the first drawing image stored in the first drawing image memory 78 based on a drawing operation corresponding to the display area 611, and transmits the updated first drawing image to the projection device 1B. The display device 6B updates the second drawing image stored in the second drawing image memory 79 based on a drawing operation corresponding to the display area 612, and transmits the updated second drawing image to the projection device 1C.

[0139] As a result, display device 6B stores a first drawn image DP1 generated in response to an operation on display area 611 in first drawn image memory 78, and stores a second drawn image DP2 generated in response to an operation on display area 612 in second drawn image memory 79. This allows display device 6B to hold multiple drawn images generated by display device 6A at different times corresponding to multiple projection devices 1B, 1C. This prevents a decrease in display quality caused by overlapping of the drawn images with the captured images corresponding to the drawn images, and allows drawn images drawn through multiple operations to be shared between projection devices 1B, 1C and display device 6B.

[0140] [4. Fourth Embodiment] FIG. 14 is a diagram showing a schematic configuration of a projection system 100C of the fourth embodiment. FIG. 15 is a block diagram of each device of the projection system 100C of the fourth embodiment. FIG. 16 is a sequence diagram showing the operation of the projection system 100C of the fourth embodiment. FIG. 17 is a schematic diagram showing the operation of the projection system 100C of the fourth embodiment. The fourth embodiment will be described with reference to these figures. In the description of the fourth embodiment, components of the projection system 100C that are common to the first or second embodiment are assigned the same reference numerals, and descriptions thereof will be omitted. Furthermore, operations of the projection system 100C that are common to the first or second embodiment are assigned the same step numbers, etc., and descriptions thereof will be omitted.

[0141] 14, projection system 100C includes projection device 1A and display devices 6C and 6D. Projection device 1A and display devices 6C and 6D are each connected to a communication network 3. Projection device 1A and display devices 6C and 6D are connected to each other so that they can communicate data with each other via communication network 3. Display device 6C corresponds to an example of a first display device, and display device 6D corresponds to an example of a second display device.

[0142] Projection device 1A is installed at usage location S1. Display device 6C is installed at usage location S2, and display device 6D is installed at usage location S4. There are no restrictions on usage locations S1, S2, and S4, and they may be located far from each other or close to each other.

[0143] The configuration of the projection device 1A is as described in the second embodiment. The display devices 6C and 6D are configured similarly to the display device 6A described in the second embodiment. In this embodiment, to distinguish between the configurations, the display 61 included in the display device 6C is referred to as the first display 61C, and the display 61 included in the display device 6D is referred to as the second display 61D. Similarly, the touch sensor 62, DP communication unit 63, and DP control unit 70 included in the display device 6C are referred to as the first touch sensor 62C, the first DP communication unit 63C, and the first DP control unit 70C, respectively. The display 61, touch sensor 62, DP communication unit 63, and DP control unit 70 included in the display device 6D are referred to as the second display 61D, the second touch sensor 62D, the second DP communication unit 63D, and the second DP control unit 70D. These configurations are as described in the second embodiment. The first touch sensor 62C corresponds to an example of a first operation unit, and the second touch sensor 62D corresponds to an example of a second operation unit. The first display communication unit 63C and the second display communication unit 63D will be referred to as the first DP communication unit 63C and the second DP communication unit 63D in the following description and drawings.

[0144] The operation of the projection system 100B will be described with reference to FIG. 16, the processes of steps SA11, SA12, SA13, SA15, SA31, SA32, and SA33 are performed by the PJ control unit 20 of the projection device 1A. The processes of steps SB11, SB13, SB14, SB18, and SB21 to SA23 are performed by the first DP control unit 70C of the display device 6C and the second DP control unit 70D of the display device 6D, respectively. Figure 16 also shows the operations of the first DP control unit 70C and the second DP control unit 70D. The operations of steps SA11, SA12, SA13, and SA15 and the operations of steps SB11, SB13, SB14, SB18, and SB21 to SA23 are the same as those described in the second embodiment, so detailed description thereof will be omitted.

[0145] In step SA11, the projection device 1A captures an image of the projection target OB to generate a captured image, and in step SA12, transmits the generated captured image to the display device 6C and the display device 6D.

[0146] The display device 6C receives the captured image in step SB11, and displays the received captured image on the display 61 in step SB12. If the display device 6C receives an operation using the indicator 65 in step SB13, it generates a drawn image based on the operation in step SB14. In step SB21, the display device 6C displays the drawn image generated in step SB14 on the display 61. In step SB21, the display device 6C displays the drawn image on the captured image being displayed on the display 61 in an overlapping manner.

[0147] Furthermore, in step SB22, the display device 6C transmits the drawn image generated in step SB14 to the projection device 1A, and proceeds to step SB18.

[0148] The display device 6D receives the captured image in step SB11, and displays the received captured image on the display 61 in step SB12. If the display device 6D receives an operation using the indicator 65 in step SB13, it generates a drawn image based on the operation in step SB14. In step SB21, the display device 6D displays the drawn image generated in step SB14 on the display 61. In step SB21, the display device 6D displays the drawn image on the captured image being displayed on the display 61 in an overlapping manner.

[0149] Furthermore, in step SB22, the display device 6D transmits the drawn image generated in step SB14 to the projection device 1A, and proceeds to step SB18.

[0150] In step SA13, projection device 1A receives an image from either or both of display devices 6C and 6D. Projection device 1A then proceeds to step SA31 to identify the display device 6 that is the sender of the received image. That is, projection device 1A identifies whether the sender of the image received in step SA13 is display device 6C or display device 6D.

[0151] In step SA32, the projection device 1A updates the image stored in the received image memory 27 based on the identification result in step SA31.

[0152] In the fourth embodiment, the projection device 1A stores an image corresponding to the display device 6C and an image corresponding to the display device 6D in the received image memory 27. The projection device 1A combines the image received from the display device 6C with the image corresponding to the display device 6C in the received image memory 27, and updates the image stored in the received image memory 27. The projection device 1A also combines the image received from the display device 6D with the image corresponding to the display device 6D in the received image memory 27, and updates the image stored in the received image memory 27.

[0153] In step SA33, the projection device 1A projects the image stored in the updated received image memory 27 by the projection unit 10, and then proceeds to step SA15.

[0154] For example, the projection device 1A projects a composite image of the image received from the display device 6C and the image received from the display device 6D onto the projection target OB.

[0155] 17 shows operating states ST1, ST2, ST3, and ST4 of the projection system 100A. The projection target OB of the projection device 1A is configured as a plane OB1, and an object OB2 is placed thereon, as in the second embodiment.

[0156] In state ST1, the projection device 1A captures an image of the plane OB1 and the object OB2 to generate a captured image P31, and transmits the captured image P31 to the display devices 6C and 6D. The captured image P31 includes an object image OP11 that is a captured image of the object OB2. The display device 6C receives the captured image P31 and displays it on the first display 61C. The display device 6D receives the captured image P31 and displays it on the second display 61D.

[0157] State ST2 is a state in which an operation is performed on display devices 6C and 6D using indicator 65. Display device 6C draws drawn image DP31 based on the operation of indicator 65. Display device 6C displays drawn image DP31 on the first display 61C and transmits a transmission image P32 including drawn image DP31 to projection device 1A. Display device 6D draws drawn image DP32 based on the operation of indicator 65. Display device 6D displays drawn image DP32 on the second display 61D and transmits a transmission image P33 including drawn image DP32 to projection device 1A. Drawn image DP31 and drawn image DP32 are examples of a "first DP drawn image" and a "second DP drawn image," respectively.

[0158] The projection device 1A receives the transmitted images P32 and P33. Based on the transmitted image P32, the projection device 1A updates the image corresponding to the display device 6C in the received image memory 27. Specifically, the image already stored in the received image memory 27 in association with the display device 6C is combined with the transmitted image P32 to update the image. The projection device 1A also updates the image corresponding to the display device 6D in the received image memory 27 based on the transmitted image P33. Specifically, the image already stored in the received image memory 27 in association with the display device 6D is updated to a combined image obtained by combining the stored image with the transmitted image P33.

[0159] A projection system 100C according to the fourth embodiment includes a projection device 1A, a display device 6C, and a display device 6D. The display device 6C includes a first DP communication unit 63C, a first display 61C, and a first touch sensor 62C. The display device 6C displays a captured image received from the projection device 1A by the first DP communication unit 63C on the first display 61C, generates a first DP drawing image based on a drawing operation received by the first touch sensor 62C while the captured image is being displayed, and transmits the generated first DP drawing image to the projection device 1A via the first DP communication unit 63C. The display device 6D includes a second DP communication unit 63D, a second display 61D, and a second touch sensor 62D. The display device 6D displays the captured image received from the projection device 1A by the second DP communication unit 63D on the second display 61D, generates a second DP drawing image based on a drawing operation received by the second touch sensor 62D while the captured image is being displayed, and transmits the generated second DP drawing image to the projection device 1A by the second DP communication unit 63D. The projection device 1A includes a PJ communication unit 42, a projection unit 10, and an image capturing unit 15. The projection device 1A communicates with the display devices 6C and 6D by the PJ communication unit 42, projects the first DP drawing image received from the display device 6C and the second DP drawing image received from the display device 6D by the projection unit 10, and transmits, to the display devices 6C and 6D, an image captured by the image capturing unit 15 of an area including the projection target onto which the first DP drawing image and the second DP drawing image are projected.

[0160] In a control method for a projection system 100C including a projection device 1A, a display device 6C, and a display device 6D, the display device 6C displays a captured image received from the projection device 1A by a first DP communication unit 63C on a first display 61C, generates a first DP drawing image based on a drawing operation received by a first touch sensor 62C while the captured image is being displayed, and transmits the generated first DP drawing image to the projection device 1A by the first DP communication unit 63C. The display device 6D displays a captured image received from the projection device 1A by a second DP communication unit 63D on a second display 61D, generates a second DP drawing image based on a drawing operation received by a second touch sensor 62D while the captured image is being displayed, and transmits the generated second DP drawing image to the projection device 1A by the second DP communication unit 63D. The projection device 1A communicates with the display devices 6C and 6D via the PJ communication unit 42, projects the first DP drawing image received from the display device 6C and the second DP drawing image received from the display device 6D via the projection unit 10, and transmits to the display devices 6C and 6D a captured image taken by the capture unit 15 of the range including the projection target onto which the first DP drawing image and the second DP drawing image are projected.

[0161] According to the projection system 100C of the fourth embodiment, the state of the projection target OB of the projection device 1A can be displayed by the display devices 6C and 6D. Furthermore, an image drawn based on the operation of the display device 6C and an image drawn based on the operation of the display device 6D can be projected by the projection device 1A. Therefore, the state of the projection target OB and the content of the drawing operation can be shared between the user of the projection device 1A and the user of the display device 6C, and between the user of the projection device 1A and the user of the display device 6D.

[0162] Projection device 1A includes a received image memory 27 that stores images received via PJ communication unit 42. Projection device 1A stores drawn image DP31 received from display device 6C and drawn image DP32 received from display device 6D in received image memory 27. Projection device 1A updates the image stored in received image memory 27 each time it receives drawn image DP31 or second drawn image DP32, and projects the updated image in received image memory 27 via projection unit 10. This allows projection device 1A to store multiple drawn images generated by display device 6C at different times in received image memory 27. The same applies to display device 6D. This allows projection device 1A to project multiple drawn images generated by display device 6C and display device 6D at different times. This prevents degradation of display quality due to overlapping of drawn images with corresponding captured images, and allows drawn images drawn through multiple operations to be shared between projection device 1A and display device 6A.

[0163] 5. Other Embodiments The above-described embodiments are preferred embodiments of the present invention, but the present invention is not limited to these and various modifications are possible within the scope of the present invention.

[0164] 3 and 4 are merely examples, and the configurations of the projection unit 10 and the image capturing unit 15 included in the projection device 1 can be changed as desired. For example, the image capturing unit 15 may be configured as a separate unit from the projection device 1. The same applies to the projection devices 1A, 1B, and 1C.

[0165] The configurations of the projection devices 1, 1A, 1B, and 1C and the display devices 6, 6A, 6B, 6C, and 6D shown in Figures 2, 7, 11, and 15 indicate functional configurations, and the specific implementation forms are not particularly limited. In other words, it is not necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which a single processor executes a program to realize the functions of multiple functional units. Furthermore, some of the functions realized by software in the above embodiments and modifications may be realized by hardware, and some of the functions realized by hardware may be realized by software.

[0166] 5, 8, 12, and 16 are divided into processing units according to the main processing content in order to facilitate understanding of the operation of each device in projection systems 100, 100A, 100B, and 100C, and the present invention is not limited by the way in which the processing units are divided or the names of the processing units. The processing executed by each device can be divided into more processing units according to the processing content, or one processing unit can be divided so that it includes even more processes.

[0167] The control program 26 may be recorded on a recording medium that is readable by the projection devices 1, 1A, 1B, and 1C. The recording medium may be a magnetic or optical recording medium or a semiconductor memory device. Specific examples include portable or fixed recording media such as flexible disks, optical disk recording media, magneto-optical disk recording media, and semiconductor storage devices. Alternatively, these programs may be stored on a server device or the like, and downloaded from the server device as needed. The same applies to the control program 76. [Explanation of symbols]

[0168] 1, 1A, 1B, 1B, 1C...Projection device, 2...Remote control, 3...Communication network, 10, 10B, 10C...Projection unit, 11...Image light formation unit, 12...Projection optical system, 13...Drive circuit, 14...Emitting and receiving device, 15...Photographing unit, 15B...First photographing unit, 15C...Second photographing unit, 20...Projection device control unit, 21...Processor, 25...Memory, 26...Control program, 27...Received image memory, 31...Operation unit, 32...Remote control light receiving unit, 33...Input interface, 39...Bus, 41...Connection unit, 42...PJ communication unit, 42B...First PJ communication unit, 42C...Second P J communication unit, 43...image processing unit, 61...display, 61C...first display, 61D...second display, 62...touch sensor (operation unit), 62C...first touch sensor (first operation unit), 62D...second touch sensor (second operation unit), 63...DP communication unit, 63C...first DP communication unit, 63D...second DP communication unit, 65...indicator, 70...DP control unit, 71...processor, 75...memory, 76...control program, 77...drawing image memory, 78...first drawing image memory, 79...second drawing image memory, 100, 100A, 100B, 100C...projection system.

Claims

1. A projection system including a first projection device, a second projection device, and a display device, the first projection device, The device includes a first projection unit, a first image capture unit, and a first PJ communication unit, projecting the image received from the display device by the first PJ communication unit using the first projection unit; capturing an image of an area including a projection target of the first projection unit with the first capturing unit to generate a first captured image; The first captured image is transmitted by the first project communication unit; the second projection device, a second projection unit, a second image capture unit, and a second PJ communication unit; projecting the image received from the display device by the second PJ communication unit using the second projection unit; capturing an image of an area including a projection target of the second projection unit with the second capture unit to generate a second captured image; The second captured image is transmitted by the second project communication unit. The display device includes: The device includes a display, an operation unit, and a DP communication unit, communicating with the first projection device and the second projection device by the DP communication unit; displaying a first captured image received from the first projection device in a first area of ​​the display, generating a first area drawing image based on a drawing operation corresponding to the first area received by the operation unit, and transmitting the first area drawing image to the first projection device; displaying the second captured image received from the second projection device in a second area of ​​the display, generating a second area drawing image based on the drawing operation corresponding to the second area received by the operation unit, and transmitting the second area drawing image to the second projection device; Projection system.

2. the display device comprises a first drawn image memory for storing the first region drawn image, and a second drawn image memory for storing the second region drawn image; updating the first region drawing image stored in the first drawing image memory based on the drawing operation corresponding to the first region, and transmitting the updated first region drawing image to the first projection device; The projection system of claim 1, wherein the second area drawing image stored in the second drawing image memory is updated based on a drawing operation corresponding to the second area, and the updated second area drawing image is transmitted to the second projection device.

3. A control method for a projection system including a first projection device, a second projection device, and a display device, comprising: the first projection device, The device includes a first projection unit, a first image capture unit, and a first PJ communication unit, receiving an image from the display device by the first projector communication unit; projecting the received image onto a projection target by the first projection unit; generating a first captured image by capturing an area including a projection target of the first projection unit with the first capturing unit; The first captured image is transmitted by the first project communication unit; the second projection device, a second projection unit, a second image capture unit, and a second PJ communication unit; receiving an image from the display device by the second projector communication unit; projecting the received image by the second projection unit; capturing an image of an area including a projection target of the second projection unit with the second capture unit to generate a second captured image; The second captured image is transmitted by the second project communication unit. The display device includes: The device includes a display, an operation unit, and a DP communication unit, communicating with the first projection device and the second projection device by the DP communication unit, displaying a first captured image received from the first projection device in a first area of ​​the display, generating a first area drawing image based on a drawing operation corresponding to the first area received by the operation unit, and transmitting the first area drawing image to the first projection device; displaying the second captured image received from the second projection device in a second area of ​​the display, generating a second area drawing image based on the drawing operation corresponding to the second area received by the operation unit, and transmitting the second area drawing image to the second projection device; A method for controlling a projection system.

Images