Projection system, control device, and image projection method

The projection system addresses the challenge of displaying three-dimensional images by using a screen forming device with nozzles and controlled liquid discharge to project cross-sectional images, achieving enhanced three-dimensional effects.

JP7577956B2Active Publication Date: 2024-11-06SEIKO EPSON CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020161700
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-09-28
Publication Date
2024-11-06
Estimated Expiration
2040-09-28

AI Technical Summary

Technical Problem

Conventional projection systems using liquid screens struggle to display images with a three-dimensional effect due to the limitations of projecting planar images.

Method used

A projection system that includes a screen forming device with nozzles to discharge liquid onto the optical path of image light, controlled by a control device that processes three-dimensional shape data to project cross-sectional images, aligning nozzle positions and ejection timings to create a three-dimensional effect.

Benefits of technology

The system effectively projects images with a three-dimensional effect by accurately reproducing three-dimensional shapes through coordinated control of nozzles and image light projection, enhancing the perceived depth and realism of displayed images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577956000001
    Figure 0007577956000001
  • Figure 0007577956000002
    Figure 0007577956000002
  • Figure 0007577956000003
    Figure 0007577956000003
Patent Text Reader

Abstract

To provide a projection system that displays an image having a more stereoscopic feeling with the use of a screen using liquid.SOLUTION: A projection system 1 has a screen forming device 3 that forms a screen by discharging liquid from a plurality of nozzles and a projector 2, acquires three-dimensional shape data composed of a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis, divides the three-dimensional shape data in the X-axis direction to generate cross-sectional shape data, acquires the coordinates of the cross-sectional shape data, executes matching processing of associating the coordinates of the cross-sectional shape data, pixels with which the projector 2 draws an image, the nozzles of the screen forming device 3, and the height of the liquid discharged from the nozzles in a discharge space 30A, and projects the image on the screen according to the association performed in the matching processing.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a projection system, a control device, and an image projection method. [Background technology]

[0002] Conventionally, there is known a technique for forming a screen using liquid and projecting an image onto the screen (see, for example, Patent Document 1). The projection system described in Patent Document 1 forms a screen by blowing mist generated by an ultrasonic vibrator upwards using a fan. This projection system projects an image onto the screen formed from the mist using a projector. In addition, a screen of a size according to the projected image is formed by driving the fan that blows out the mist. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-121655 A Summary of the Invention [Problem to be solved by the invention]

[0004] The image projected by the configuration described in Patent Document 1 is a two-dimensional image in which image data is expanded in a video RAM, which poses a problem that it is difficult to display an image with a three-dimensional feel. [Means for solving the problem]

[0005] One aspect for solving the above problem is a projection system for projecting image light onto a screen, the projection system including: a screen forming device having a plurality of nozzles, and forming the screen by ejecting liquid from the nozzles onto an optical path of the image light; a light source; and a light modulation device modulating light emitted by the light source to form the image light, the projection system projecting the image light onto the screen; and a control device for controlling the projection system and the screen forming device based on the cross-sectional shape data, the screen forming device including a data generation unit that divides three-dimensional shape data to generate cross-sectional shape data. the nozzles of the projection device are arranged side by side on an XY plane along the X-axis, which is the direction in which the screen corresponding to the cross-sectional shape data overlaps, and the Y-axis direction intersecting the X-axis; the light modulation device of the projection device has a configuration that forms an image using a plurality of pixels and modulates the light emitted by the light source using the pixels; and the control device has a matching processing unit that associates the coordinates of the cross-sectional shape data, the coordinates of the pixels of the projection device, the nozzles of the screen forming device, and the height of the ejection space from the nozzle in the Z-axis direction perpendicular to the XY plane.

[0006] Another aspect for solving the above problem is a projection system that projects image light onto a screen, the projection system comprising: a screen forming device having a plurality of nozzles, which forms the screen by discharging liquid from the nozzles onto an optical path of the image light; and a projection device that draws an image using a plurality of pixels and projects the image light modulated by the pixels onto the screen, wherein the screen forming device has the nozzles arranged in the X-axis direction and the Y-axis direction, where the direction along the image light is defined as the X-axis, the axis perpendicular to the X-axis is defined as the Y-axis, and the axis perpendicular to the X-axis and the Y-axis is defined as the Z-axis. The projection system has a memory unit that stores three-dimensional display formation data obtained by performing a matching process that associates coordinates of cross-sectional shape data obtained by dividing three-dimensional shape data in the X-axis direction with the pixels and the height of an ejection space in the Z-axis direction from the nozzles, and drives the pixels and the nozzles of the screen forming device based on the three-dimensional display formation data stored in the memory unit of the projection system.

[0007] Yet another aspect for solving the above problem is a projection system comprising: a projection device that projects the image light, the projection device including a light source and a light modulation device that modulates light emitted by the light source to form image light; a screen forming device that includes a plurality of nozzles arranged in a first direction along the optical path of the image light and in a second direction intersecting the first direction, the screen forming device forming a screen by ejecting liquid from the nozzles onto the optical path of the image light; and a control device that controls the projection device and the screen forming device based on cross-sectional shape data obtained by dividing three-dimensional shape data, the control device causing the projection device to project the image light of an image based on the cross-sectional shape data, controlling the timing of ejecting the liquid from the plurality of nozzles arranged in the second direction based on the cross-sectional shape data, and controlling the timing of ejecting the liquid from the plurality of nozzles arranged in the first direction to match the timing at which the projection device switches the cross-sectional shape data.

[0008] Another aspect for solving the above problem is a control device used in combination with a projection device that projects image light and a screen forming device that forms a screen by ejecting liquid from a plurality of nozzles onto an optical path of the image light, the control device comprising: a data generation unit that acquires three-dimensional shape data configured in a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis that are mutually orthogonal, and divides the three-dimensional shape data to generate cross-sectional shape data; and a matching processing unit that associates the coordinates of the cross-sectional shape data, the pixels at which the projection device draws an image, the nozzles of the screen forming device, and the height in the ejection space of the liquid ejected from the nozzles.

[0009] Another aspect for solving the above problem is an image projection method for projecting an image using a screen forming device that forms a screen by ejecting liquid from a plurality of nozzles, and a projection device that draws an image using a plurality of pixels and projects the image light modulated by the pixels onto the screen, the image projection method comprising the steps of: acquiring three-dimensional shape data configured in a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis that are mutually orthogonal; dividing the three-dimensional shape data in the X-axis direction to generate cross-sectional shape data; acquiring coordinates of the cross-sectional shape data; performing a matching process that associates the coordinates of the cross-sectional shape data with the pixels on which the projection device draws the image, the nozzles of the screen forming device, and the height in an ejection space of the liquid ejected from the nozzles; and driving the pixels and the nozzles of the screen forming device in accordance with the association made by the matching process based on the cross-sectional shape data, to project an image onto the screen. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of a projection system. [Diagram 2] FIG. 2 is an explanatory diagram showing a projection state by the projection system. [Diagram 3] Schematic diagram of a liquid recovery system. [Figure 4] FIG. 2 is a diagram showing the configuration of a discharge head. [Diagram 5] FIG. 1 is a block diagram showing the functional configuration of a projection system. [Figure 6] 6 is an explanatory diagram of an operation for detecting the height of a discharge space. [Figure 7] 13 is a flowchart showing a height detection process. [Figure 8] FIG. 4 is an explanatory diagram of an operation for detecting a projection distance. [Figure 9] 6 is a flowchart showing a projection distance detection process. [Figure 10] FIG. 4 is an explanatory diagram of cross-sectional image data generation processing. [Figure 11] 11 is a flowchart showing a cross-sectional image data generating process. [Figure 12] 5 is a flowchart showing the operation of the projection system in the first embodiment. [Figure 13] 5A to 5C are explanatory diagrams showing an example of the operation of the screen forming apparatus in the first embodiment. [Figure 14] 4A and 4B are diagrams showing examples of cross-sectional images projected by the projection system. [Figure 15] FIG. 4 is an explanatory diagram showing the transition of a projection state in the first embodiment. [Figure 16] 10 is a flowchart showing the operation of a projection system in a second embodiment. [Figure 17] FIG. 11 is an explanatory diagram showing the transition of a projection state in a second embodiment. [Figure 18] 10 is a flowchart showing the operation of a projection system in a third embodiment. [Figure 19] FIG. 13 is an explanatory diagram showing the transition of a projection state in a third embodiment. [Figure 20] 10 is a flowchart showing the operation of a projection system in a fourth embodiment. [Figure 21] FIG. 13 is an explanatory diagram showing the transition of a projection state in a fourth embodiment. [Figure 22] 13 is a flowchart showing the operation of a projection system in a fifth embodiment. [Figure 23] FIG. 13 is an explanatory diagram showing the transition of a projection state in the fifth embodiment. [Figure 24] 13 is a flowchart showing the operation of a projection system in a sixth embodiment. [Diagram 25] FIG. 23 is an explanatory diagram showing the transition of a projection state in the sixth embodiment. [Figure 26] 20 is a flowchart showing the operation of a projection system in a seventh embodiment. [Figure 27] FIG. 23 is a perspective view showing an example of the configuration of a discharge head according to an eighth embodiment. [Figure 28] FIG. 13 is a perspective view showing an example of the configuration of a discharge head according to a ninth embodiment. [Figure 29] FIG. 23 is an explanatory diagram showing an example of the operation of the projection system according to the tenth embodiment. [Diagram 30] FIG. 23 is a block diagram of a projection system according to an eleventh embodiment. [Diagram 31] FIG. 23 is a block diagram of a projection system according to a twelfth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] [1. First embodiment] [1-1. Overall configuration of projection system 1]

[0012] FIG. 1 is a diagram showing a schematic configuration of a projection system 1. As shown in FIG. The projection system 1 includes a projector 2, a screen forming device 3, and a control device 10. The projector 2 projects image light PL under the control of the control device 10. The screen forming device 3 has a screen forming section 30. The screen forming section 30 includes an ejection head 31 that ejects liquid, and a recovery unit 32 that recovers the liquid ejected by the ejection head 31. The screen forming section 30 causes the liquid to flow down as droplets DP into an ejection space 30A between the ejection head 31 and the recovery unit 32.

[0013] The control device 10 controls the projector 2 and the screen forming device 3 to cause the screen forming section 30 to form a screen and the projector 2 to project the image light PL. The projector 2 corresponds to an example of a projection device.

[0014] The discharge head 31 is equipped with a plurality of nozzles 33, which will be described later, and discharges droplets DP from the nozzles 33. As will be described in detail later, the nozzles 33 are arranged in a row on the discharge head 31. Therefore, the droplets DP fall linearly through the discharge space 30A along the arrangement direction of the nozzles 33, and land on the recovery unit 32.

[0015] The liquid used by the screen forming device 3 is composed of a liquid whose main component is water or an organic solvent, and the most typical example is water or a mixture of water and other liquids. This liquid may be a solution in which inorganic and / or organic substances are dissolved. The liquid used by the screen forming device 3 may be any liquid that has the optical property of reflecting and / or diffusing visible light.

[0016] FIG. 2 is an explanatory diagram showing a projection state by the projection system 1. As shown in FIG. As shown in FIG. 2, the projector 2 is disposed facing the screen forming unit 30 and projects the image light PL toward the screen forming unit 30. The optical axis of the image light PL projected by the projector 2 is indicated by the symbol PAX. The optical axis PAX is a virtual axis that is the center of the image light PL, and is, for example, an axis passing through the optical center of a projection lens (not shown) of the projector 2. The projection system 1 specifies the position in the screen forming unit 30 by an XYZ orthogonal coordinate system consisting of an X axis parallel to the optical axis PAX, a Y axis perpendicular to the X axis, and a Z axis perpendicular to the X axis and the Y axis. The XY plane is a plane perpendicular to the X axis, and the Z axis is, for example, a vertical direction. Note that the X axis is not limited to being parallel to the optical axis PAX, and may be inclined with respect to the optical axis. The X axis is also a direction along the image light described later, and is also a direction in which a screen corresponding to the cross-sectional shape data described later overlaps.

[0017] The screen forming unit 30 forms a plurality of screens SCX1, SCX2, SCX3, etc. aligned in the X-axis direction. These screens SCX1, SCX2, SCX3, etc. are formed while the droplets DP fall in the discharge space 30A after the droplets DP are discharged from the discharge head 31. The projector 2 projects the image light PL in accordance with the timing at which the screens SCX1, SCX2, SCX3, etc. are formed in the discharge space 30A under the control of the control device 10. For example, the projector 2 projects a planar image FP1 at the timing at which the screen SCX1 is formed, and projects a planar image FP2 at the timing at which the screen SCX2 is formed. As a result, a plurality of planar images FP1, FP2, FP3, etc. are formed in the discharge space 30A. Since the plurality of planar images FP1, FP2, FP3, etc. are projected in an overlapping manner in the X-axis direction, the projection optical system of the projector 2 uses an optical system with a deep depth of field. Alternatively, it is preferable to automatically adjust the focus in accordance with the imaging positions of the plurality of planar images FP1, FP2, FP3, .... The ejection space 30A may be configured to be surrounded by a case, or may be configured by a frame.

[0018] In this embodiment, the projection system 1 projects cross-sectional images obtained by slicing one stereoscopic image TP as planar images FP1, FP2, FP3.... The projection system 1 can display the stereoscopic image TP as a three-dimensional image by projecting the planar images FP1, FP2, FP3... onto a plurality of screens SCX1, SCX2, SCX3... arranged in the X-axis direction.

[0019] In this embodiment, an example will be described in which the planar image FP displayed by the projector 2 is a still image, but it may be a moving image, that is, a video image.

[0020] 1, the screen forming apparatus 3 includes a liquid supply system 35 that supplies liquid to the discharge head 31 and takes in the liquid recovered by the recovery unit 32. The screen forming apparatus 3 also includes a head control unit 36 ​​that controls the discharge head 31 and the liquid supply system 35.

[0021] Droplets DP ejected from ejection head 31 land on recovery unit 32 and become liquid and accumulate there. The liquid accumulated in recovery unit 32 is recovered to liquid supply system 35 through recovery pipe 352. Liquid supply system 35 supplies the liquid recovered from recovery unit 32 to ejection head 31 through liquid supply pipe 351.

[0022] FIG. 3 is a schematic diagram of the liquid supply system 35. Liquid supply system 35 includes pumps 353 and 354, a sub-tank 355, and a main tank 356. Pumps 353 and 354 are driven by head control unit 36 ​​to transport liquid. Sub-tank 355 and main tank 356 are tanks that store liquid, and main tank 356 is connected to sub-tank 355 via pipe 357.

[0023] A liquid level detector 304 for detecting the liquid level is disposed in the subtank 355. The liquid level detector 304 is configured, for example, with a sensor for detecting the height of the liquid surface. Specifically, the liquid level detector 304 may be an optical sensor for detecting the presence or absence of liquid at a predetermined height position, or a float-type sensor for detecting whether a float is floating on the liquid surface.

[0024] The subtank 355 is connected to the recovery unit 32 by a recovery pipe 352. A pump 353 is provided in the recovery pipe 352, and droplets DP dropped into the recovery unit 32 are transported inside the recovery pipe 352 by the pump 353 and stored in the subtank 355. The subtank 355 is also connected to the discharge head 31 by a liquid supply pipe 351. A pump 354 is provided in the liquid supply pipe 351, and the liquid stored in the subtank 355 is supplied to the discharge head 31 through the liquid supply pipe 351 by the pump 354.

[0025] When the liquid amount detection unit 304 detects that the amount of liquid stored in the sub tank 355 is less than a predetermined amount, liquid is supplied from the main tank 356 to the sub tank 355. In this case, the head control unit 36 ​​may control the supply of liquid from the main tank 356 to the sub tank 355 by driving a pump or valve (not shown) provided in the pipe 357. Also, a configuration may be used in which liquid automatically flows from the main tank 356 to the sub tank 355 depending on the amount of liquid in the sub tank 355 and the amount of liquid in the main tank 356, without control by the head control unit 36.

[0026] FIG. 4 is a diagram showing the configuration of the ejection head 31, in which the configuration of the nozzle arrangement surface 31A is indicated by reference symbol A, and the height position in the ejection space 30A is indicated by reference symbol B. A plurality of nozzles 33 are arranged in the X-axis direction and the Y-axis direction on the nozzle arrangement surface 31A. Each nozzle 33 is an outlet that ejects droplets DP. The nozzles 33 are connected to a liquid ejection mechanism (not shown) built into the ejection head 31, and liquid pushed out by the liquid ejection mechanism reaches the nozzles 33 and is ejected as droplets DP. Examples of the liquid ejection mechanism include a mechanism that pushes out liquid by passing electricity through a piezoelectric element, a mechanism that pushes out liquid by heating and expanding the liquid, and a mechanism that pushes out liquid by generating bubbles through heating. The liquid ejection mechanism may also be configured to include a pressurizing mechanism that pressurizes the liquid and a valve that opens and closes a flow path for the liquid.

[0027] A plurality of nozzles 33 aligned in the Y-axis direction constitute a nozzle row 34. The pitch PY between the nozzles 33 in the nozzle row 34 is constant. The positions of the nozzles 33 in the Y-axis direction are designated Y1, Y2, Y3, ..., Yn, where n is the number of nozzles 33 included in one nozzle row 34 and is an arbitrary natural number.

[0028] On the nozzle arrangement surface 31A, a plurality of nozzle rows 34 are arranged side by side in the X-axis direction. The pitch PX of the nozzle rows 34 in the X-axis direction is constant. The positions of the nozzle rows 34 in the X-axis direction are designated as X1, X2, X3, ..., Xm. m is the number of nozzle rows 34 arranged on the nozzle arrangement surface 31A and is any natural number.

[0029] Each nozzle 33 of the ejection head 31 can be identified by a position X1, X2, X3, ..., Xm in the X-axis direction and a position Y1, Y2, Y3, ..., Yn in the Y-axis direction. These can also be called the X coordinate and the Y coordinate in the ejection space 30A.

[0030] In the following description, the position of the droplet DP in the Z-axis direction is indicated by positions Z1, Z2, Z3, ..., Zl in the Z-axis direction, where l is an arbitrary natural number. The positions Z1, Z2, Z3, ..., Zl can also be called Z coordinates in the ejection space 30A. Therefore, the position of the droplet DP in the ejection space 30A can be specified by the X and Y coordinates of the nozzle 33 that ejected the droplet DP, and the Z coordinate.

[0031] [1-2. Control system of projection system 1] FIG. 5 is a block diagram showing the functional configuration of the projection system 1. As shown in FIG. 5, the control device 10 is connected to each of the projector 2 and the screen forming device 3. The connection between the control device 10 and the projector 2 and the connection between the control device 10 and the screen forming device 3 may be, for example, a wired connection via a data communication cable, or a wireless connection using a wireless data communication line.

[0032] The control device 10 includes a first control unit 11, an interface unit 16, and a first storage unit 17. The first control unit 11 includes a processor such as a CPU (Central Processing Unit) or a microcomputer, and a ROM (Read Only Memory) (not shown). The first control unit 11 executes a program stored in the ROM by the processor, and realizes a data processing function and a control function of the projection system 1 through cooperation between software and hardware. The first storage unit 17 is a storage device that non-volatilely stores the program executed by the first control unit 11, the data processed by the first control unit 11, and the like.

[0033] The interface unit 16 connects the control device 10 to an external device of the control device 10 so as to enable data communication between the control device 10. The interface unit 16 may be a communication device that executes wired data communication via a cable. The interface unit 16 may also be a wireless communication device. The projector 2, the screen forming device 3, and the image source 4 are connected to the interface unit 16.

[0034] The image source 4 is a device that supplies data related to the stereoscopic image TP projected by the projection system 1. Examples of the image source 4 include a personal computer, a tablet computer, a smartphone, a disc-type recording media playback device, and a data storage.

[0035] The first control unit 11 includes a data acquisition unit 12, a data generation unit 13, a matching processing unit 14, and a projection control unit 15. Each of these units is a functional configuration realized by the above-mentioned program.

[0036] The data acquisition unit 12 acquires data related to the stereoscopic image TP projected by the projection system 1. In this embodiment, the data acquisition unit 12 acquires three-dimensional shape data input to the interface unit 16 from the image source 4. The data generating unit 13 generates cross-sectional shape data based on the three-dimensional shape data acquired by the data acquiring unit 12 .

[0037] The matching processing unit 14 performs matching processing for projecting into the ejection space 30A the planar image FP based on the cross-sectional shape data generated by the data generating unit 13. The details of the matching processing will be described later.

[0038] The projection control unit 15 controls the projector 2 and the screen forming device 3 in accordance with the result of the matching process executed by the matching processing unit 14, and causes them to project the three-dimensional image TP into the ejection space 30A.

[0039] The projector 2 includes a second control unit 201 that controls each unit of the projector 2, and a projection unit 20. The projector 2 forms an optical image by the projection unit 20, and projects the image light PL. The projection unit 20 corresponds to an example of a display unit.

[0040] The projection unit 20 includes a light source 21, a light modulation device 22, and a projection optical system 23. The projection unit 20 corresponds to an example of a display unit. A light source drive circuit 204 and a light modulation device drive circuit 205 that operate under the control of a second control unit 201 are connected to the projection unit 20. The projector 2 includes an image processing unit 206 that processes images, and an interface unit 203 .

[0041] The light source 21 includes a lamp such as a halogen lamp, a xenon lamp, or an extra-high pressure mercury lamp, or a solid-state light source such as an LED (Light Emitting Diode) or a laser light source. The light source 21 may include a reflector that guides light emitted from the light source to the light modulation device 22, and an auxiliary reflector. Furthermore, the light source 21 may include a lens group for improving the optical characteristics of the projection light, a polarizing plate, or a dimming element that reduces the amount of light emitted from the light source on the path to the light modulation device 22. The light source drive circuit 204 turns the light source of the light source 21 on and off under the control of the second control unit 201.

[0042] The light modulation device 22 includes a light modulation element and generates image light by modulating the light emitted by the light source 21. The light modulation device 22 includes, for example, a panel 221 as the light modulation element, in which a plurality of display pixels are arranged in a matrix. The panel 221 is, for example, a transmissive liquid crystal display panel or a reflective liquid crystal display panel, but may also be a digital micromirror device. The light modulation device 22 may include three panels 221 corresponding to the three primary colors of R, G, and B, and in this case, includes a synthesis optical system that synthesizes the color lights modulated by the three panels 221. Alternatively, the light modulation device 22 may be configured to modulate the three colors of R, G, and B using one panel 221.

[0043] In this embodiment, an example will be described in which a panel 221 is used in which pixels are arranged along a Y axis and a Z axis that are orthogonal to each other, as shown in Fig. 2. In this example, each pixel in the panel 221 is identified by a Y coordinate and a Z coordinate. The YZ plane of the panel 221 corresponds to an image plane that is orthogonal to the optical axis PAX. The panel 221 has a plurality of pixels, and forms an image using these plurality of pixels, and modulates light emitted by the light source 21 using these pixels.

[0044] The light modulation device 22 is driven by a light modulation device driving circuit 205. The light modulation device driving circuit 205 is connected to an image processing unit 206. Image data corresponding to each of the primary colors R, G, and B is input to the light modulation device driving circuit 205 from the image processing unit 206. The light modulation device driving circuit 205 drives each pixel of the panel 221 based on the input image data, and draws an image on the panel 221.

[0045] The projection optical system 23 has optical components such as lenses and mirrors, and projects the image light PL modulated by the light modulation device 22 toward the screen forming section 30. The projection optical system 23 may also include a zoom mechanism, a focus adjustment mechanism, and the like.

[0046] The image processing unit 206 includes a frame memory (not shown) as a temporary storage area for image processing. The frame memory is configured, for example, by a Synchronous Dynamic Random Access Memory (SDRAM).

[0047] Image data is input from the control device 10 to the image processing unit 206 under the control of the second control unit 201. This image data is, for example, cross-sectional shape data for projecting a planar image FP. The image processing unit 206 loads the input image data in a frame memory. The image processing unit 206 performs various types of image processing on the image data loaded in the frame memory, such as resolution conversion processing or resizing processing, distortion aberration correction, shape correction processing, digital zoom processing, and image adjustment processing for adjusting the color tone and brightness of the image.

[0048] The image processing unit 206 can be configured by an integrated circuit such as an LSI, an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a system-on-a-chip (SoC).

[0049] The second control unit 201 has a processor such as a CPU or a microcomputer, and is connected to the memory 202. The memory 202 is a storage device that stores programs and data in a non-volatile manner. The second control unit 201 executes the programs stored in the memory 202 by the processor, and realizes the control function of the projector 2 through cooperation between software and hardware.

[0050] The second control unit 201 causes the image processing unit 206 to execute image processing based on the image data input to the interface unit 203. The second control unit 201 controls the light source driving circuit 204 and the light modulation device driving circuit 205 to cause the projection unit 20 to display an image based on the image data processed by the image processing unit 206.

[0051] Furthermore, the projector 2 includes a distance measuring unit 207. The second control unit 201 uses the distance measuring unit 207 to measure the distance from the projector 2 to the screen formation unit 30.

[0052] The screen forming apparatus 3 includes a third control unit 301 , a head driving unit 302 , a pump driving unit 303 , a liquid amount detection unit 304 , and a liquid droplet sensor 305 . The third control unit 301 includes a processor such as a CPU or a microcomputer, and controls each unit of the screen forming apparatus 3. The third control unit 301 includes, for example, a ROM (not shown), and executes a program stored in the ROM to realize the control function of the screen forming apparatus 3 through cooperation between software and hardware.

[0053] The head driving unit 302 drives an ejection mechanism (not shown) included in the ejection head 31 to eject droplets DP from a nozzle 33 selected from among the nozzles 33 included in the ejection head 31 . Pump driving unit 303 drives pumps 353, 354 included in liquid supply system 35. Liquid amount detection unit 304 detects the amount of liquid stored in subtank 355, as described above.

[0054] The droplet sensor 305 is a sensor that detects when the droplets DP discharged from the discharge head 31 land on the recovery unit 32 .

[0055] [1-3. Detecting the projection environment] The detection operation that is executed before the projection system 1 projects the stereoscopic image TP will be described. FIG. 6 is an explanatory diagram of the operation of detecting the height of the ejection space 30A, and FIG. 7 is a flowchart showing the height detection process executed by the projection system 1.

[0056] In the recovery unit 32, a first droplet sensor 305A and a second droplet sensor 305B constituting the droplet sensor 305 are disposed. The first droplet sensor 305A detects that the droplet DP discharged from the discharge head 31 has landed on the recovery unit 32. The second droplet sensor 305B is the same. The first droplet sensor 305A and the second droplet sensor 305B are configured, for example, by a pressure sensor, a capacitance sensor, or the like. It is preferable that the first droplet sensor 305A and the second droplet sensor 305B are disposed at different positions in the X-axis direction or the Y-axis direction. It is more preferable that the first droplet sensor 305A and the second droplet sensor 305B are disposed at both ends of the recovery unit 32 in the X-axis direction or the Y-axis direction. For example, the first droplet sensor 305A and the second droplet sensor 305B can be disposed directly under the nozzles 33 at both ends included in the same nozzle row 34.

[0057] By determining the time difference between when the droplets DP are discharged from the discharge head 31 and when the first droplet sensor 305A detects the impact of the droplets DP, it is possible to determine the arrival time of the droplets DP from the discharge head 31 to the recovery unit 32. From this arrival time, it is possible to determine the distance between the discharge head 31 and the recovery unit 32 at the position of the first droplet sensor 305A, i.e., the height H of the discharge space 30A. Similarly, the screen forming device 3 can determine the height H of the discharge space 30A at the position of the second droplet sensor 305B.

[0058] The operation shown in Fig. 7 is executed under the control of the third control unit 301. In detail, the control device 10 outputs control data instructing the screen forming device 3 to execute a height detection process, and the third control unit 301 executes the operation shown in Fig. 7 according to the control data.

[0059] The third control unit 301 starts detection by the first droplet sensor 305A and the second droplet sensor 305B (step S11), and executes preliminary ejection from the ejection head 31 (step S12). Preliminary ejection refers to an ejection operation that does not affect the projection of an image, and in this case refers to ejection for height detection. In step S12, the third control unit 301 ejects droplets DP from the nozzle 33 located directly above the first droplet sensor 305A and the nozzle 33 located directly above the second droplet sensor 305B.

[0060] The third control unit 301 acquires the detection values ​​of the first droplet sensor 305A and the second droplet sensor 305B (step S13). The third control unit 301 calculates the arrival time of the droplet DP from the detection value of the first droplet sensor 305A (step S14). The third control unit 301 also calculates the arrival time of the droplet DP from the detection value of the second droplet sensor 305B (step S15).

[0061] The third control unit 301 calculates the height H of the ejection space 30A based on the arrival times calculated in steps S14 and S15, and further calculates the inclination of the ejection space 30A (step S16). In detail, the third control unit 301 calculates the inclination of the ejection space 30A by determining the difference between the height H at the position of the first droplet sensor 305A and the height H at the position of the second droplet sensor 305B. The third control unit 301 also calculates the height of the ejection space 30A based on the height H at the position of the first droplet sensor 305A and the height H at the position of the second droplet sensor 305B. For example, the average of the height H at the position of the first droplet sensor 305A and the height H at the position of the second droplet sensor 305B is set to the height of the ejection space 30A.

[0062] The third control section 301 generates height data indicating the height of the ejection space 30A and inclination data indicating the inclination of the ejection space 30A, and outputs them to the control device 10 (step S17). The third control unit 301 may calculate correction data for correcting the ejection timing of the multiple nozzles 33 based on the tilt data generated in step S17. For example, when ejecting droplets DP from multiple nozzles 33 aligned in the Y-axis direction, the third control unit 301 may set a time difference in the timing of ejecting the droplets DP for each nozzle 33 so that the droplets DP land simultaneously on the collection unit 32. Data correlating this time difference with the position of the nozzle 33 may be calculated as a correction parameter, and the calculated correction parameter may be output to the control device 10.

[0063] FIG. 8 is an explanatory diagram of the operation of detecting the projection distance, and FIG. 9 is a flowchart showing the projection distance detection process. The projector 2 includes a first distance measuring unit 207A and a second distance measuring unit 207B that configure the distance measuring unit 207. In this embodiment, the first distance measuring unit 207A is a TOF (Time Of Flight) type distance measuring sensor, and includes a detection light source that emits detection light, and a light receiving sensor that receives reflected light of the detection light. For example, a laser light source is used as the detection light source. The second distance measuring unit 207B includes a detection light source and a light receiving sensor, similar to the first distance measuring unit 207A. As the first distance measuring unit 207A and the second distance measuring unit 207B, a known distance measuring sensor that can optically detect distance can be used. Note that the first distance measuring unit 207A and the second distance measuring unit 207B may be a distance measuring device that measures distance using ultrasonic waves.

[0064] A first reflecting section 37A and a second reflecting section 37B that reflect the detection light are disposed in the collection unit 32. The first reflecting section 37A has a reflecting material that reflects the detection light of the first distance measuring section 207A and the detection light of the second distance measuring section 207B, and is, for example, a mirror made of metal, glass, synthetic resin, etc. The same is true for the second reflecting section 37B. The first reflecting section 37A and the second reflecting section 37B are disposed on a surface of the screen forming section 30 that faces the projector 2. In this embodiment, they are disposed in the recovery unit 32. The first reflecting section 37A and the second reflecting section 37B are preferably disposed at different positions in the Y-axis direction.

[0065] The operation shown in Fig. 9 is executed under the control of the second control unit 201. In detail, the control device 10 outputs control data instructing the projector 2 to execute a distance detection process, and the second control unit 201 executes the operation of Fig. 9 according to this control data.

[0066] The second control unit 201 executes distance detection by the first distance measuring unit 207A (step S21). In step S21, the second control unit 201 causes the light source of the first distance measuring unit 207A to emit light, obtains a detection value of the light receiving sensor of the first distance measuring unit 207A, and calculates the distance from the first distance measuring unit 207A to the first reflecting unit 37A. The second control unit 201 executes distance detection by the second distance measuring unit 207B (step S22). In step S22, the second control unit 201 causes the light source of the second distance measuring unit 207B to emit light, obtains a detection value of the light receiving sensor of the second distance measuring unit 207B, and calculates the distance from the second distance measuring unit 207B to the second reflecting unit 37B. The second control unit 201 may execute the operation of step S21 and the operation of step S22 simultaneously or in parallel, or may execute them in the reverse order.

[0067] The second control unit 201 calculates the difference between the distance measured by the first distance measuring unit 207A and the distance measured by the second distance measuring unit 207B (step S23). If there is a difference in the distance calculated in step S23, the projector 2 does not face the screen forming unit 30, that is, the angle of the YZ plane of the screen forming unit 30 with respect to the optical axis PAX of the projector 2 is not a right angle. The second control unit 201 calculates a correction parameter based on the difference calculated in step S23 (step S24). The correction parameter calculated in step S24 may be a parameter for changing the direction of the image light PL projected by the projection unit 20, that is, the angle of the optical axis PAX, in accordance with the position of the screen forming unit 30. The correction parameter may also be a parameter for performing geometric correction of the projected image of the projector 2. The second control unit 201 or the control device 10 may also output a message or data to the user operating the projection system 1 to guide the user to adjust the installation position of the projector 2 and / or the screen forming device 3.

[0068] [1-4. Operation of Projection System 1] FIG. 10 is an explanatory diagram of the cross-sectional image data generating process executed by the control device 10, and FIG. 11 is a flowchart showing the cross-sectional image data generating process. The control device 10 acquires three-dimensional shape data 18 from the image source 4, and generates cross-sectional shape data 18A from the three-dimensional shape data 18. FIG. 10 shows an example of the three-dimensional shape data 18. The three-dimensional shape data 18 is data that represents a stereoscopic shape, and the data format is not limited. For example, it may be STL data or OBJ data. The control device 10 converts the three-dimensional shape data 18 into coordinate data in an XYZ orthogonal coordinate system, for example, as shown in FIG. 10.

[0069] The control device 10 generates cross-sectional shape data 18A from the three-dimensional shape data 18. The cross-sectional shape data 18A is planar image data of a cross-section obtained by cutting the three-dimensional shape data 18 at an arbitrary position in the X-axis direction. The cross-sectional shape data 18A is expressed as a figure in the YZ plane, for example, and is composed of Y coordinates and Z coordinates. The projection system 1 forms a plurality of screens with different X coordinates using droplets DP, and projects the plurality of cross-sectional shape data 18A onto the screens with the X coordinates corresponding to each of the cross-sectional shape data 18A, thereby displaying a stereoscopic image so that the user can view it.

[0070] 11, the control device 10 acquires the three-dimensional shape data 18 by the data acquisition unit 12 (step S31). The three-dimensional shape data 18 acquired in step S31 is stored in the first storage unit 17. Next, the data generating unit 13 executes coordinate conversion of the three-dimensional shape data 18 (step S32). In step S32, the data generating unit 13 associates the X-axis with the three-dimensional shape data 18. That is, the data generating unit 13 specifies the relative direction of the three-dimensional shape data 18 with respect to the optical axis PAX of the projector 2, and arranges the three-dimensional shape data 18 in accordance with the X-axis. The three-dimensional shape data 18 may be displayed in any direction relative to the projection direction of the projector 2. The data generating unit 13 associates the X-axis with the three-dimensional shape data 18 in a direction specified by the user by operating the control device 10, or in a direction specified in advance. Furthermore, the data generating unit 13 associates the Y-axis and Z-axis perpendicular to the X-axis with the three-dimensional shape data 18. The data generating unit 13 converts the coordinates of the surface of the three-dimensional shape data 18 into coordinates in the XYZ coordinate system. For example, the data generating unit 13 specifies the position of the surface of the three-dimensional shape data 18 that is composed of polygons, and calculates the coordinates of each position of the specified surface. In step S32, the data generator 13 may enlarge, reduce, transform, or the like the three-dimensional shape data 18.

[0071] The three-dimensional shape data 18 may also be placed at any position in the Y-axis and Z-axis directions. The data generating unit 13 places the three-dimensional shape data 18 in the Y-axis and Z-axis directions at a position specified by the user operating the control device 10, or at a position specified in advance. For example, the data generating unit 13 may place the three-dimensional shape data 18 so that it is closest to the X-axis. The data generating unit 13 may also place the three-dimensional shape data 18 so that the center of the three-dimensional shape data 18 overlaps with a predetermined Y coordinate and Z coordinate.

[0072] The data generation unit 13 determines the number of divisions α for dividing the three-dimensional shape data 18 in the X-axis direction based on the number m of nozzle rows 34 in the X-axis direction and the maximum and minimum values ​​of the X coordinate of the three-dimensional shape data 18 that has been coordinate-converted (step S33). For example, the minimum value of the X coordinate of the three-dimensional shape data 18 in Fig. 10 is PXa and the maximum value is PXb. The data generating unit 13 determines the division number α so that the range of X coordinates PXa-PXb is evenly or appropriately assigned to the m nozzle rows 34.

[0073] The data generation unit 13 determines positions for dividing the three-dimensional shape data 18 based on the division number α determined in step S33 and the maximum and minimum values ​​of the X coordinate of the three-dimensional shape data 18 (step S34). In step S34, the X coordinate of the division position is obtained.

[0074] The data generating unit 13 obtains the cross-sectional contour of the three-dimensional shape data 18 at the X coordinate determined in step S34 (step S34), and generates cross-sectional shape data 18A of the obtained cross-sectional contour (step S35).

[0075] The operation shown in FIG. 11 is just one example. As a process for generating cross-sectional shape data from three-dimensional shape data by a process including coordinate conversion, for example, a known method disclosed in Japanese Patent Application Laid-Open No. 2000-339465 can be adopted.

[0076] FIG. 12 is a flowchart showing the operation of the projection system 1 in the first embodiment, and FIG. 13 is an explanatory diagram showing an example of the operation of the screen forming device 3 in the first embodiment. The operations described with reference to FIGS. 12 and 13 are executed by the first control unit 11 following the operations described with reference to FIGS.

[0077] The data generating unit 13 performs coordinate conversion of the cross-sectional shape data 18A to convert it into data of a planar image having Y coordinates and Y coordinates (step S41). As a result, the cross-sectional shape data 18A becomes data of a planar image in the YZ plane, for example, as shown in Fig. 10. The cross-sectional shape data 18A converted in step S41 is stored in the first storage unit 17.

[0078] Next, the matching processing unit 14 executes a matching process between the position of the nozzle 33 in the Y-axis direction and the coordinates of the pixels in the Y-axis direction of the panel 221 based on the maximum and minimum values ​​of the Y coordinate of the cross-sectional shape data 18A (step S42). In step S42, matching is performed to associate the pixels of the panel 221 with the Y coordinate of the cross-sectional shape data 18A, and thus the pixels that display the image of the cross-sectional shape data 18A on the panel 221 are determined in the Y-axis direction. Also, in step S42, matching is performed to associate the position of the nozzle 33 in the Y-axis direction with the Y coordinate of the cross-sectional shape data 18A, and thus the position in the Y-axis direction of the droplets DP involved in the display of the cross-sectional shape data 18A can be specified. That is, the nozzle 33 that discharges the droplets DP to display the cross-sectional shape data 18A is determined.

[0079] The matching processing unit 14 executes a matching process with the coordinates of pixels in the Z-axis direction of the panel 221 based on the maximum and minimum values ​​of the Z coordinate of the cross-sectional shape data 18A (step S43). As a result, matching is performed to associate the pixels of the panel 221 with the Z coordinate of the cross-sectional shape data 18A, so that the pixels that display the image of the cross-sectional shape data 18A on the panel 221 are determined in the Z-axis direction.

[0080] The matching processing unit 14 executes a matching process between the maximum and minimum values ​​of the Z coordinate of the cross-sectional shape data 18A and the position in the height H direction of the ejection space 30A (step S44). This makes it possible to identify the position in the Z axis direction of the droplet DP when the cross-sectional shape data 18A is displayed on the screen forming unit 30.

[0081] Based on the cross-sectional shape data 18A, the matching processing unit 14 executes a matching process between the ejection timing of the screen forming device 3 and the display timing of the panel 221 (step S45). Specifically, based on the Z coordinate of the cross-sectional shape data 18A matched in step S44 and the position of the droplet DP in the Z-axis direction, the matching processing unit 14 determines the timing for drawing the image of the cross-sectional shape data 18A on the panel 221 and the ejection timing of the droplet DP for each nozzle 33.

[0082] The matching processing unit 14 generates matching processing data indicating the results of the matching in steps S42-S45, and stores the data in the first storage unit 17 (step S46).

[0083] Next, the control device 10 displays a stereoscopic image based on the three-dimensional shape data. That is, the control device 10 causes the projector 2 to project an image and the screen forming device 3 to form a screen. The operations described below may be performed by the projection control unit 15 controlling the projector 2 and the screen forming device 3. Alternatively, the projection control unit 15 may transmit data required for display processing to the projector 2 and the screen forming device 3, and the second control unit 201 and the third control unit 301 may each perform the processing.

[0084] Under the control of the control device 10, the head driving unit 302 selects the nozzle row 34 at the Xa position from among the nozzle rows 34 of the ejection head 31 aligned in the X-axis direction. The head driving unit 302 ejects droplets DP one or more times from the nozzles 33 that are located at a position in the Y-axis direction corresponding to the cross-sectional shape data 18A, among the nozzles 33 constituting the selected nozzle row 34 (step S47).

[0085] Next, at the timing when the screen is formed by the droplets DP discharged from the nozzles 33, a cross-sectional image corresponding to the nozzle row Xa is projected by the projector 2 (step S48).

[0086] Here, the control device 10 judges whether or not the projection of all cross-sectional images constituting the three-dimensional shape data 18, i.e., images based on all cross-sectional shape data 18A, has been completed (step S49). If the projection of all cross-sectional images has been completed (step S49; YES), the control device 10 ends this process.

[0087] Moreover, if the projection of the cross-sectional image has not been completed (step S49; NO), the control device 10 sets Xa=Xa+1, switches the nozzle array 34 and the cross-sectional shape data 18A (step S50), and returns to step S47. Then, steps S47-S50 are repeatedly executed the same number of times as the number of cross-sectional shape data 18A constituting the three-dimensional shape data 18, so that the three-dimensional shape data 18 is projected into the ejection space 30A.

[0088] The operations in steps S47-S50 in FIG. 12 will be described below using a specific example. The operation example in Fig. 13 shows an example in which the discharge head 31 discharges droplets DP to form screens SCX1 and SCX2. Fig. 13 shows a schematic diagram of the state of the discharge head 31 and droplets DP at each of times t1, t2, ..., t8. For ease of understanding, Fig. 13 shows an example in which the number of nozzles 33 and nozzle rows 34 possessed by the discharge head 31 is simplified. The same applies to Figs. 27, 28, and 29 described below.

[0089] At time t1, the screen forming device 3 selects the nozzle row 34a closest to the origin in the X-axis direction, and ejects droplets DP from the nozzles 33 that make up the nozzle row 34a. Next, the screen forming device 3 ejects droplets DP from the nozzle row 34a again at time t2. The interval between times t2 and t1 is determined based on the position of the droplets DP in the height direction of the ejection space 30A matched in steps S44 and S45. Thereafter, the ejection interval of the droplets DP remains the same until time t8.

[0090] The screen forming device 3 also ejects droplets DP from the nozzles 33 of the nozzle row 34a at times t3 and t4. As a result, at time t4, a screen SCX1 is formed by droplets DP ejected four times in succession downward from the nozzle row 34a. The projector 2 draws an image on the panel 221 at time t4, and projects the image light PL into the ejection space 30A, thereby forming an image on the screen SCX1.

[0091] At time t5, the screen forming device 3 ejects droplets DP from the nozzle row 34b adjacent to the nozzle row 34a. Then, the screen forming device 3 ejects droplets DP from the nozzle row 34b at time t6. The screen forming device 3 ejects droplets DP from the nozzles 33 included in the nozzle row 34b that correspond to the cross-sectional shape data 18A. Therefore, at time t6, some of the nozzles 33 that constitute the nozzle row 34b eject droplets DP. After that, the screen forming device 3 ejects droplets DP from the nozzle row 34b at times t7 and t8.

[0092] As a result, at time t8, a screen SCX2 is formed below the nozzle row 34b. The projector 2 draws an image on the panel 221 at time t8, and projects the image light PL into the ejection space 30A, so that an image is formed on the screen SCX2.

[0093] The cross-sectional image displayed on the screen SCX1 at time t4 and the cross-sectional image displayed on the screen SCX2 at time t8 form a three-dimensional image having depth in the X-axis direction.

[0094] Furthermore, the images displayed by the operations in steps S47-S50 in FIG. 12 will be described with specific examples. FIG. 14 is a diagram showing an example of a cross-sectional image projected by the projection system 1, and FIG. 15 is an explanatory diagram showing the transition of the projection state in the first embodiment. In the following description, an example will be given in which planar images FP1, FP2, and FP3 are displayed as images based on the cross-sectional shape data 18A constituting the three-dimensional shape data 18. The planar images FP1, FP2, and FP3 are examples of the above-mentioned cross-sectional images. The planar image FP1 is an image corresponding to the cross-sectional shape data 18A at a position in the ejection head 31 where the X coordinate is the smallest. The planar image FP3 is an image corresponding to the cross-sectional shape data 18A at a position where the X coordinate is larger than that of the planar image FP1. The planar image FP2 is an image corresponding to the cross-sectional shape data 18A located between the planar images FP1 and FP3.

[0095] 15 is a front view of the ejection space 30A as viewed in the X-axis direction, and shows the YZ plane located at the X coordinate of the nozzle row 34. Y1, Y2, Y3, Y4, and Y5 are Y coordinates and correspond to the position of the nozzle 33 in the Y-axis direction. Z1, Z2, Z3, Z4, and Z5 are Z coordinates and correspond to the position of the droplet DP in the height direction.

[0096] 15 shows an example in which a nozzle row 34 includes five nozzles 33 aligned in the Y-axis direction, and the positions of droplets DP are divided into five stages in the height direction of the ejection space 30A. This example is an example in which the number of nozzles 33 and droplets DP is reduced for ease of understanding, and is not intended to limit the configuration of the present invention. The same applies to Figures 17, 19, 21, 23, and 25 described below.

[0097] 15, the position of the droplet DP in the YZ plane is indicated by a bold frame with the reference symbol PD. Also, the portion of the droplet DP irradiated with the image light PL of the projector 2 in the YZ plane is indicated by a black region with the reference symbol PP.

[0098] 15, the timing when the droplet DP discharged from the discharge head 31 reaches the coordinate Z1 is defined as time t1, and the display states at times t2, t3, ..., t15 are shown. At times t1-t5, the YZ plane corresponding to the X coordinate of the planar image FP1 is shown, at times t6-t10, the YZ plane corresponding to the X coordinate of the planar image FP2 is shown, and at times t11-t15, the YZ plane corresponding to the X coordinate of the planar image FP3 is shown.

[0099] In this example, droplets DP are discharged from nozzles 33 corresponding to pixels constituting the planar image FP1 at each of times t1-t5. Therefore, at time t5, droplets DP are present at positions corresponding to the pixels of the planar image FP1, and a screen SCX1 matching the shape of the planar image FP1 is formed. The projector 2 projects image light PL onto the screen SCX1 at time t5.

[0100] Furthermore, at each of the timings from time t6 to t10, droplets DP are ejected from the nozzles 33 corresponding to the pixels that constitute the planar image FP2. Therefore, at time t10, the droplets DP are present at positions corresponding to the pixels of the planar image FP2, and a screen SCX2 that matches the shape of the planar image FP2 is formed. The projector 2 projects the image light PL onto the screen SCX2 at time t10.

[0101] Similarly, at each of times t11-t15, droplets DP are ejected from the nozzles 33 corresponding to the pixels that form the planar image FP3. Therefore, at time t15, the droplets DP are present at positions corresponding to the pixels of the planar image FP3, and a screen SCX3 that matches the shape of the planar image FP3 is formed. The projector 2 projects the image light PL of the planar image FP3 onto the screen SCX3 at time t15.

[0102] In the first embodiment, the projector 2 sequentially displays planar images FP1, FP2, and FP3 at times t5, t10, and t15. By repeatedly executing this operation a required number of times, screens SCX1, SCX2, ... are formed in order in the X-axis direction, and cross-sectional images are displayed. Each of these cross-sectional images produces an afterimage effect in the screen formation unit 30, and the user can visually recognize the three-dimensional shape data 18 in a stereoscopic manner.

[0103] Fig. 15 shows how images are projected at the X coordinates of the flat images FP1, FP3, and FP3, but Fig. 15 is merely a diagram showing a part of the operation of the projection system 1. For this reason, it is of course possible for the projection system 1 to continue projection after time t15, and it is possible to form a screen with even more X coordinates and project flat images. The same is true for Figs. 17, 19, 21, 23, and 25, which will be described later.

[0104] [1-5. Effects of the first embodiment] As described above, the projection system 1 to which the present invention is applied projects the image light PL onto a screen. The projection system 1 includes a screen forming device 3 having a plurality of nozzles 33 and discharging liquid from the nozzles 33 onto the optical path of the image light PL to form a screen. The projection system 1 includes a light source 21 and a light modulation device 22 that modulates the light emitted by the light source 21 to form the image light PL, and a projector 2 that projects the image light PL onto a screen. The projection system 1 includes a data generating unit 13 that divides the three-dimensional shape data 18 to generate cross-sectional shape data 18A, and a control device 10 that controls the projector 2 and the screen forming device 3 based on the cross-sectional shape data 18A. The nozzles 33 of the screen forming device 3 are arranged on an XY plane along the X axis parallel to the optical axis PAX of the image light PL, which is the direction in which the screen corresponding to the cross-sectional shape data 18A overlaps, and the Y axis that intersects with the X axis. The projector 2 includes a light modulation device 22 that forms an image using a plurality of pixels of the panel 221 and modulates the light emitted by the light source 21 using these pixels. The control device 10 is equipped with a matching processing unit 14 that associates the coordinates of the cross-sectional shape data 18A, the coordinates of the pixels of the panel 221, the nozzle 33 of the screen forming device 3, and the height of the ejection space 30A from the nozzle 33 in the Z-axis direction perpendicular to the XY plane.

[0105] According to this configuration, the projector 2 can project the image light PL in accordance with the position of the droplets DP discharged into the discharge space 30A. As a result, by projecting the image light PL by the projector 2 onto the screen formed by the screen forming device 3 using liquid, it is possible to project an image with a three-dimensional effect.

[0106] In the projection system 1, the data generation unit 13 divides the three-dimensional shape data 18 in the X-axis direction to generate cross-sectional shape data 18A of a cross section perpendicular to the X-axis. The matching processing unit 14 performs matching processing on the coordinates of this cross-sectional shape data 18A, so that a three-dimensional image TP with a three-dimensional effect can be projected using the cross-sectional shape data 18A.

[0107] The screen forming device 3 drives the nozzles 33 in units of nozzle rows 34 including a plurality of nozzles 33 aligned in the X-axis or Y-axis direction. The screen forming device 3 forms a screen with the nozzle rows 34 corresponding to one piece of cross-sectional shape data 18A, and then forms another screen with the nozzle rows 34 corresponding to another piece of cross-sectional shape data 18A. This makes it possible to form a plurality of screens in the arrangement direction of the nozzle rows 34. Therefore, by projecting a planar image FP onto each screen, it is possible to project a three-dimensional image TP that is rich in three-dimensionality as a whole.

[0108] The screen forming device 3 forms a screen by ejecting liquid from nozzles 33, among the nozzles 33 included in the nozzle row 34, that correspond to the coordinates constituting the image of the cross-sectional shape data 18A. Therefore, by projecting an image based on the cross-sectional shape data 18A onto a screen formed at a position suitable for the cross-sectional shape data 18A generated from the three-dimensional shape data 18, it is possible to project a stereoscopic image TP that more accurately reproduces the three-dimensional shape data 18.

[0109] After the screen forming device 3 forms a screen corresponding to the cross-sectional shape data 18A, the projector 2 projects a cross-sectional image based on the cross-sectional shape data 18A. This makes it possible to project a stereoscopic image TP that more accurately reproduces the three-dimensional shape data 18.

[0110] The control device 10 of the present invention is a device used in combination with a projector 2 that projects image light PL, and a screen forming device 3 that forms a screen by discharging liquid from a plurality of nozzles 33 onto the optical path of the image light PL. The control device 10 includes a data generating unit 13 that acquires three-dimensional shape data 18 configured in a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis that are mutually orthogonal, and divides the three-dimensional shape data 18 to generate cross-sectional shape data 18A. The control device 10 includes a matching processing unit 14 that associates the coordinates of the cross-sectional shape data 18A, the pixels on which the projector 2 draws an image, the nozzles 33 of the screen forming device 3, and the height in the discharge space 30A of the liquid discharged from the nozzles 33. This makes it possible to generate the cross-sectional shape data 18A from the three-dimensional shape data 18, and to associate the coordinates of the cross-sectional shape data 18A, the coordinates of the pixels of the panel 221, the nozzles 33 of the screen forming device 3, and the height of the discharge space 30A in the Z-axis direction. Therefore, the image light PL can be projected in accordance with the position of the droplets DP discharged into the discharge space 30A to form an image. As a result, by projecting the image light PL by the projector 2 onto the screen formed by the screen forming device 3 using liquid, it is possible to project an image with a three-dimensional effect.

[0111] The image projection method of the present invention is an image projection method that projects an image using a screen forming device 3 and a projector 2 that draws an image using a plurality of pixels of a panel 221 and projects image light PL modulated by these pixels onto a screen. This image projection method acquires three-dimensional shape data 18 configured in a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis that are mutually orthogonal, and divides the three-dimensional shape data 18 in the X-axis direction to generate cross-sectional shape data 18A. In this image projection method, coordinates of the cross-sectional shape data 18A are acquired. Then, a matching process is executed that associates the coordinates of the cross-sectional shape data 18A with the pixels on which the projector 2 draws an image, the nozzle 33 of the screen forming device 3, and the height of the liquid discharged from the nozzle 33 in the discharge space 30A. Also, based on the cross-sectional shape data 18A, the pixels of the panel 221 and the nozzle 33 of the screen forming device 3 are driven in accordance with the association by the matching process to project an image onto the screen. According to this image projection method, the coordinates of the cross-sectional shape data 18A generated from the three-dimensional shape data 18, the coordinates on the panel 221, the nozzle 33 of the screen forming device 3, and the height of the ejection space 30A in the Z-axis direction are associated with each other. Therefore, by projecting the image light PL by the projector 2 onto the screen formed by the screen forming device 3 using liquid, it is possible to project an image with a three-dimensional effect.

[0112] The projection system 1 of the present invention includes a light source 21, a light modulation device 22 that modulates light emitted by the light source 21 to form image light PL, and a projector 2 that projects the image light PL. The projection system 1 includes a screen forming device 3 that includes a plurality of nozzles 33 arranged in a first direction along the optical path of the image light PL and a second direction intersecting the first direction, and that forms a screen by discharging liquid from the nozzles 33 onto the optical path of the image light PL. The projection system 1 includes a control device 10 that controls the projector 2 and the screen forming device 3 based on cross-sectional shape data 18A obtained by dividing three-dimensional shape data 18. The control device 10 causes the projector 2 to project the image light PL of an image based on the cross-sectional shape data 18A. The control device 10 causes the timing of discharging liquid from the plurality of nozzles 33 arranged in the second direction to be controlled based on the cross-sectional shape data 18A. The control device 10 controls the timing of discharging liquid from the plurality of nozzles 33 arranged in the first direction to match the timing at which the projector 2 switches the cross-sectional shape data 18A. As a result, by projecting the image light PL by the projector 2 in accordance with the positions of the droplets DP on the screen formed by the screen forming device 3 using liquid, it is possible to project an image with a three-dimensional effect.

[0113] In the above configuration, the matching processing data generated as a result of the matching processing executed by the matching processing unit 14 may be transmitted from the control device 10 to the projector 2, and the projector 2 may store it in the memory 202. In this case, the memory 202 corresponds to a storage unit. The second control unit 201 may control the projection unit 20 and the screen forming device 3 according to the matching processing data stored in the memory 202 to execute projection. In other words, the second control unit 201 may operate each unit of the projector 2 and the screen forming device 3 to execute the formation of the screen and the projection of the image light PL, similar to the projection control unit 15. In this case, in the projection system 1, the screen forming device 3 has nozzles 33 arranged in the X-axis and Y-axis directions, assuming that an axis parallel to the projection direction of the projector 2 is the X-axis, an axis perpendicular to the X-axis is the Y-axis, and an axis perpendicular to the X-axis and Y-axis is the Z-axis. The projector 2 has a memory 202 that stores three-dimensional display formation data obtained by performing a matching process that associates the coordinates of cross-sectional shape data 18A obtained by dividing the three-dimensional shape data 18 in the X-axis direction with the pixels of the panel 221 and the height of the discharge space 30A in the Z-axis direction from the nozzle 33. The projection system 1 drives the panel 221 and the nozzle 33 of the screen forming device 3 based on the three-dimensional display formation data stored in the memory 202.

[0114] [2. Second embodiment] Fig. 16 is a flowchart showing the operation of the projection system 1 in the second embodiment. Fig. 17 is an explanatory diagram showing the transition of the projection state in the second embodiment. In the second embodiment, the configuration of the projection system 1 is the same as the configuration described in the first embodiment, so illustration and description thereof will be omitted.

[0115] In the operation shown in FIG. 16, steps S41-S46 and steps S49-S50 are common to FIG. Under the control of the control device 10, the projection system 1 selects the nozzle row 34 of the ejection head 31 aligned in the X-axis direction by the head driving unit 302. The head driving unit 302 ejects droplets DP once from all the nozzles 33 constituting the selected nozzle row 34 (step S55). The projector 2 projects a cross-sectional image corresponding to the nozzle row Xa (step S56).

[0116] Thereafter, the control device 10 proceeds to step S49, and judges whether or not the projection of all the cross-sectional images constituting the three-dimensional shape data 18, i.e., images based on all the cross-sectional shape data 18A, has been completed (step S49). If the projection of all the cross-sectional images has been completed (step S49; YES), the control device 10 ends this process. If the projection of the cross-sectional images has not been completed (step S49; NO), the control device 10 sets Xa=Xa+1, switches the nozzle row 34 and the cross-sectional shape data 18A (step S50), and returns to step S55. Then, steps S55, S56, S49, and S50 are repeatedly executed the number of times corresponding to the number of cross-sectional shape data 18A constituting the three-dimensional shape data 18, whereby the three-dimensional shape data 18 is projected into the ejection space 30A.

[0117] Fig. 17 is a front view of the ejection space 30A as seen in the X-axis direction, similar to Fig. 15, and shows the YZ plane located at the X coordinate of the nozzle row 34. In Fig. 17, the position of the droplet DP in the YZ plane is indicated by a bold frame with the reference symbol PD. Also, the portion of the droplet DP irradiated with the image light PL of the projector 2 in the YZ plane is indicated by a black region with the reference symbol PP. Also, the portion where the image light PL of the projector 2 reaches the YZ plane but is not irradiated with the droplet DP is indicated by hatching with the reference symbol PR.

[0118] 15, in Fig. 17, the timing when the droplet DP discharged from the discharge head 31 reaches the coordinate Z1 is set as time t1, and the display states at times t2, t3, ..., t15 are shown. At times t1-t5, the YZ plane corresponding to the X coordinate of the planar image FP1 is shown, and at times t6-t10, the YZ plane corresponding to the X coordinate of the planar image FP2 is shown. At times t11-t15, the YZ plane corresponding to the X coordinate of the planar image FP3 is shown.

[0119] 17, droplets DP are ejected from all nozzles 33 included in the nozzle row 34 at the X coordinate corresponding to the planar image FP1. Therefore, at times t1-t5, the droplets DP are aligned at each of the coordinates Y1-Y5 and descend in the ejection space 30A.

[0120] The projector 2 starts projecting the image light PL of the planar image FP1 from time t1 when the droplet DP reaches a height position Z1 corresponding to the projection position of the image. This projection of the image light PL continues until time t5. At a position where the image light PL overlaps with the height position of the droplet DP, the image light PL hits the droplet DP as indicated by the symbol PP, and the pixels of the planar image FP1 are visible. At each of the timings t1-t5, the pixels constituting the planar image FP1 are visible at each of the height positions Z1-Z5. In contrast, at a position where the image light PL does not overlap with the droplet DP, the image is not visible.

[0121] At times t6-t10, droplets DP are ejected from all nozzles 33 constituting the nozzle row 34 at the X coordinate corresponding to the projection position of the planar image FP2, and descend through the ejection space 30A. The projector 2 projects the image light PL of the planar image FP2 at times t6-t10. At positions where the image light PL overlaps with the height position of the droplets DP, the image light PL hits the droplets DP, and the pixels of the planar image FP2 are visible. In this way, the pixels constituting the planar image FP2 are visible at each of the height positions Z1-Z5 at each of the timings of times t6-t10.

[0122] At times t11-t15, droplets DP are discharged from all nozzles 33 constituting the nozzle row 34 at the X coordinate corresponding to the projection position of the flat image FP3, and descend through the discharge space 30A. The projector 2 projects the image light PL of the flat image FP3 at times t11-t15. Then, at each of the timings of times t11-t15, the pixels constituting the flat image FP3 are visible at each of the height positions Z1-Z5.

[0123] According to the second embodiment, the same effects as those of the first embodiment can be obtained. In addition, the screen forming device 3 forms a screen by ejecting droplets DP from a plurality of nozzles 33, including nozzles 33 included in a nozzle row 34 corresponding to the cross-sectional shape data 18A that are not associated with coordinates that constitute the image of the cross-sectional shape data 18A. Therefore, for example, there is no need to select the nozzle 33 in step S55. This has the advantage that the control of the projector 2 and the screen forming device 3 can be simplified and a stereoscopic image can be efficiently projected.

[0124] Furthermore, the projector 2 projects a cross-sectional image based on the cross-sectional shape data 18A in accordance with the timing at which the screen forming device 3 ejects droplets DP from the nozzle array 34 corresponding to the cross-sectional shape data 18A. For this reason, the projector 2 needs to start and switch the projection of the image light PL less frequently. This has the advantage that the control of the projector 2 and the screen forming device 3 can be simplified and a stereoscopic image can be efficiently projected.

[0125] [3. Third embodiment] FIG. 18 is a flowchart showing the operation of the projection system 1 in the third embodiment, and FIG. 19 is an explanatory diagram showing the transition of the projection state in the third embodiment. In the third embodiment, the configuration of the projection system 1 is the same as the configuration described in the first embodiment, so illustration and description thereof will be omitted.

[0126] In the operation shown in FIG. 18, steps S41-S46 and steps S49-S50 are common to FIG. Under the control of the control device 10, the projection system 1 selects a nozzle row 34 of the ejection head 31 aligned in the X-axis direction by the head driving unit 302. The head driving unit 302 ejects droplets DP multiple times in succession from all the nozzles 33 constituting the selected nozzle row 34 (step S61). The projector 2 projects a cross-sectional image corresponding to the nozzle row Xa (step S62).

[0127] Thereafter, the control device 10 proceeds to step S49, and judges whether or not the projection of all the cross-sectional images constituting the three-dimensional shape data 18, i.e., images based on all the cross-sectional shape data 18A, has been completed (step S49). If the projection of all the cross-sectional images has been completed (step S49; YES), the control device 10 ends this process. If the projection of the cross-sectional images has not been completed (step S49; NO), the control device 10 sets Xa=Xa+1, switches the nozzle row 34 and the cross-sectional shape data 18A (step S50), and returns to step S55. Then, steps S61, S62, S49, and S50 are repeatedly executed the number of times corresponding to the number of cross-sectional shape data 18A constituting the three-dimensional shape data 18, whereby the three-dimensional shape data 18 is projected into the ejection space 30A.

[0128] 15 and 17, Fig. 19 is a front view of the ejection space 30A as seen in the X-axis direction, and shows the YZ plane located at the X coordinate of the nozzle row 34. The symbols PD, PP, and PR in Fig. 19 are the same as those in Fig. 17.

[0129] 15, in Fig. 19, the timing when the droplet DP discharged from the discharge head 31 reaches the coordinate Z1 is taken as time t1, and the display states at times t2, t3, ..., t18 are shown. At times t1-t9, the YZ plane corresponding to the X coordinate of the planar image FP1 is shown, and at times t10-t18, the YZ plane corresponding to the X coordinate of the planar image FP2 is shown.

[0130] In the example of Fig. 19, droplets DP are continuously discharged at a predetermined time interval from all nozzles 33 included in the nozzle row 34 of the X coordinate corresponding to the planar image FP1. The discharge interval of the droplets DP is set in advance corresponding to the time it takes for the droplets DP to descend between Z1 and Z2. The number of times the droplets DP are discharged is set according to the number of Z coordinates in the YZ plane. In the example of Fig. 19, droplets DP are continuously discharged five times from the nozzles 33 corresponding to the Z coordinates Z1-Z5.

[0131] The projector 2 starts projecting the image light PL of the planar image FP1 from time t1 when the droplet DP reaches a height position Z1 corresponding to the projection position of the image. The projection of this image light PL is performed during the period when the droplet DP exists at the X coordinate corresponding to the planar image FP1, and continues until time t9 in the example of Fig. 19.

[0132] At times t1-t9, where the image light PL overlaps with the height position of the droplet DP, the image light PL hits the droplet DP as indicated by the symbol PP, and pixels of the planar image FP1 are visible. Also, at each of the timings of times t1-t9, pixels constituting the planar image FP1 are visible at each of the height positions Z1-Z5. In contrast, no image is visible at positions where the image light PL does not overlap with the droplet DP.

[0133] At times t10-t18, the droplets DP descend in the discharge space 30A at the X coordinate corresponding to the projection position of the flat image FP2. The projector 2 projects the image light PL of the flat image FP2 at times t10-t18. At positions where the image light PL overlaps with the height position of the droplets DP, the image light PL hits the droplets DP, and the pixels of the flat image FP2 are visible. In this way, the pixels constituting the flat image FP2 are visible at each of the height positions Z1-Z5 at each of the timings of times t10-t18.

[0134] According to the third embodiment, the same effects as those of the first and second embodiments can be obtained. Furthermore, in the third embodiment, by discharging droplets DP continuously multiple times from the nozzle 33, many droplets DP are arranged on one YZ plane, and the planar images FP1, FP2 can be clearly projected. Then, the image light PL is projected by the projector 2 during the entire period when the droplets DP exist on the YZ plane, so that the user can visually recognize an afterimage for a long period of time. This allows the user to clearly visually recognize each of the planar images FP constituting the three-dimensional image TP, and a three-dimensional image TP with a richer sense of depth can be projected.

[0135] [4. Fourth embodiment] FIG. 20 is a flowchart showing the operation of the projection system 1 in the fourth embodiment, and FIG. 21 is an explanatory diagram showing the transition of the projection state in the fourth embodiment. In the fourth embodiment, the configuration of the projection system 1 is the same as the configuration described in the first embodiment, so illustration and description thereof will be omitted.

[0136] In the operation shown in FIG. 18, step S41 is common to FIG. The matching processing unit 14 sets the number of divisions Vn in the height direction of the ejection space 30A based on the maximum and minimum values ​​of the Z coordinate of the cross-sectional shape data 18A (step S71). Next, the data generating unit 13 generates line segment shape data showing an image of the cross-sectional shape data 18A (step S72). The line segment shape data is data obtained by extracting pixels located at specific Z coordinates in the image of the cross-sectional shape data 18A, and is a line segment having a size of one pixel in the Z axis direction and extending in the Y axis direction. In step S72, the data generating unit 13 generates line segment shape data at multiple Z coordinates of the image of the cross-sectional shape data 18A. Here, the size of one pixel may correspond to one pixel of the panel 221, or multiple pixels corresponding to the Z coordinate of the panel 221 may be one pixel, and the size including these pixels may be the size of one pixel.

[0137] The data generating unit 13 specifies the X coordinate, the Y coordinate, and the Z coordinate of the line segment shape data generated in step S72 (step S73). The matching processing unit 14 executes a matching process between the position of the nozzle 33 in the Y-axis direction and the coordinates of the pixels in the Y-axis direction of the panel 221 based on the maximum and minimum values ​​of the Y coordinate of the line segment shape data (step S74). In step S74, matching is performed to associate the pixels of the panel 221 with the Y coordinate of the line segment shape data, thereby determining the position of the pixels of the line segment shape data in the Y-axis direction of the panel 221. Also in step S74, matching is performed to associate the position of the nozzle 33 in the Y-axis direction with the Y coordinate of the line segment shape data, thereby specifying the position in the Y-axis direction of the droplets DP involved in displaying the line segment shape data. In other words, the nozzles 33 that eject droplets DP to display the line segment shape data are determined.

[0138] The matching processing unit 14 executes a matching process with the coordinates of pixels in the Z-axis direction of the panel 221 based on the maximum and minimum values ​​of the Z coordinates of the cross-sectional shape data 18A (step S75). The process of step S75 is the same as step S43. As a result, the pixels of the panel 221 and the Z coordinates of the cross-sectional shape data 18A are associated with each other, and the pixels that display the image of the cross-sectional shape data 18A on the panel 221 are determined in the Z-axis direction.

[0139] The matching processing unit 14 executes a matching process between the maximum and minimum values ​​of the Z coordinate of the cross-sectional shape data 18A and the position in the height H direction of the ejection space 30A (step S76), similarly to step S44. This allows the position of the droplet DP in the Z axis direction to be specified when the cross-sectional shape data 18A is displayed on the screen forming unit 30.

[0140] Based on the line segment shape data, the matching processing unit 14 executes a matching process between the discharge timing of the screen forming device 3 and the display timing of the panel 221 (step S77). As a result, matching is performed so that the timing of drawing the image of the line segment shape data on the panel 221 is aligned with the position of the droplet DP in the Z-axis direction.

[0141] The matching processing unit 14 generates matching processing data indicating the results of the matching in steps S71-S77, and stores the data in the first storage unit 17 (step S78).

[0142] The control device 10 displays a stereoscopic image based on the three-dimensional shape data. That is, the control device 10 causes the projector 2 to project an image and the screen forming device 3 to form a screen. The operations described below may be performed by the projection control unit 15 controlling the projector 2 and the screen forming device 3. Alternatively, the projection control unit 15 may transmit data required for display processing to the projector 2 and the screen forming device 3, and the second control unit 201 and the third control unit 301 may each perform the processing.

[0143] Under the control of the control device 10, the head driving unit 302 selects the nozzle row 34 at the Xa position from among the nozzle rows 34 of the ejection head 31 aligned in the X-axis direction. The head driving unit 302 ejects a droplet DP once from the nozzle 33 that is located at a position in the Y-axis direction corresponding to the cross-sectional shape data 18A, among the nozzles 33 constituting the selected nozzle row 34 (step S79).

[0144] Next, at the timing when the screen is formed by the droplets DP discharged from the nozzles 33, the projector 2 projects an image of the line segment shape data of the Z coordinate corresponding to the nozzle row Xa (step S80). In step S80, the projector 2 sequentially projects images of the multiple line segment shape data in accordance with the Z coordinates of the droplets DP.

[0145] Here, the control device 10 judges whether or not the projection of all cross-sectional images constituting the three-dimensional shape data 18, i.e., images based on all cross-sectional shape data 18A, has been completed (step S81). If the projection of all cross-sectional images has been completed (step S81; YES), the control device 10 ends this process.

[0146] Moreover, if the projection of the cross-sectional image has not been completed (step S81; NO), the control device 10 sets Xa=Xa+1, switches the nozzle array 34 and the cross-sectional shape data 18A (step S82), and returns to step S47. Then, steps S79-S82 are repeatedly executed the same number of times as the number of cross-sectional shape data 18A constituting the three-dimensional shape data 18, so that the three-dimensional shape data 18 is projected into the ejection space 30A.

[0147] 21, like Fig. 17, is a front view of the ejection space 30A as seen in the X-axis direction, and shows the YZ plane located on the X coordinate of the nozzle row 34. The symbols PD, PP, and PR in Fig. 21 are the same as those in Fig. 17.

[0148] Fig. 21(a) shows the display state of a planar image FP1, Fig. 21(b) shows the display state of a planar image FP2, and Fig. 21(c) shows the display state of a planar image FP3. Times t1, t2, ..., t7 in Fig. 21(a), (b), and (c) are common. That is, Fig. 21(a), (b), and (c) show the display states of planar images FP1, FP2, and FP3 displayed on the YZ plane of different X coordinates at the common time t1-t7.

[0149] In the example of FIG. 21, droplets DP are ejected once from all the nozzles 33 included in the nozzle row 34 at the X coordinate corresponding to the planar image FP1. The projector 2 projects an image of the line segment shape data corresponding to the Z coordinate Z1 at time t1 when the droplet DP reaches a height position Z1 corresponding to the projection position of the image. At time t2, the projector 2 projects an image of the line segment shape data corresponding to the Z coordinate Z2, and at time t3, the projector 2 projects an image of the line segment shape data corresponding to the Z coordinate Z3. Similar operations are continued until time t5 when the droplet DP is located at the Z coordinate Z5 of the lowest stage.

[0150] On the other hand, the projector 2 does not project the flat image FP2 at time t1. This is because the image of the line segment shape data of the flat image FP1 is projected at position Z1 at time t1. The projector 2 projects the image light PL of the line segment shape data corresponding to the Z1 position of the flat image FP2 at time t2. The projector 2 continues to project the image of the line segment shape data until time t6, in accordance with the position of the droplet DP corresponding to the flat image FP2.

[0151] Furthermore, the projector 2 does not project the flat image FP3 at times t1 and t2. This is because the image of the line segment shape data of the flat image FP1 is projected at position Z1 at time t1, and the image of the line segment shape data of the flat image FP2 is projected at position Z1 at time t2. The projector 2 projects the image light PL of the line segment shape data corresponding to the Z1 position of the flat image FP3 at time t3. The projector 2 continues to project the image of the line segment shape data until time t7, in accordance with the position of the droplet DP corresponding to the flat image FP3.

[0152] 21, droplets DP that become screens onto which the planar images FP1, FP2, and FP3 are projected are discharged from the nozzle 33 at different timings. The projector 2 projects images based on the line segment shape data of the planar images FP1, FP2, and FP3 in accordance with the discharge timing of each droplet DP and the Z coordinate of the droplet DP.

[0153] According to the fourth embodiment, the same effects as those of the first, second and third embodiments can be obtained. Furthermore, in the fourth embodiment, the data generating unit 13 of the control device 10 generates line segment shape data by dividing the cross-sectional shape data 18A in the Z-axis direction. The matching processing unit 14 associates the coordinates of the line segment shape data, the coordinates of the pixels on the panel 221 of the projector 2, the nozzle 33 of the screen forming device 3, and the height of the ejection space 30A from the nozzle 33 in the Z-axis direction. As a result, the image of the cross-sectional shape data 18A can be projected onto the screen by projecting the line segment shape data obtained by dividing the cross-sectional shape data 18A in the Z-axis direction in accordance with the position of the droplet DP in the Z-axis direction. By using the line segment shape data, images related to multiple cross-sectional shape data 18A can be projected while shifting them in the Z-axis direction. Therefore, images related to multiple cross-sectional shape data 18A can be projected in parallel without overlapping, so the entire three-dimensional shape data 18 can be projected in a short time. As a result, a stereoscopic image TP with a greater sense of depth can be projected.

[0154] Furthermore, the screen forming device 3 drives the nozzles 33 in units of nozzle rows 34 including a plurality of nozzles 33 aligned in the X-axis direction or the Y-axis direction. The screen forming device 3 forms one screen by droplets DP ejected from one nozzle row 34. Then, by ejecting liquid from the plurality of nozzle rows 34 corresponding to the plurality of cross-sectional shape data 18A with a time difference, before one screen is formed, formation of another screen begins. This allows a plurality of screens to be formed in parallel, and allows the projector 2 to project images based on a plurality of cross-sectional shape data 18A in parallel.

[0155] Furthermore, the screen forming device 3 forms a linear screen having a unit height in the Z-axis direction by droplets DP discharged from the nozzle row 34. Therefore, the projector 2 can project images based on line segment shape data divided in the Z-axis direction in parallel, thereby projecting images based on a plurality of cross-sectional shape data 18A.

[0156] Furthermore, the projector 2 projects a linear image in accordance with the height of the linear screen in the Z-axis direction. This allows images related to multiple cross-sectional shape data 18A to be projected in parallel without overlapping, making it possible to project the entire three-dimensional shape data 18 in a short time. This allows a stereoscopic image TP with a more three-dimensional feel to be projected.

[0157] [5. Fifth Embodiment] FIG. 22 is a flowchart showing the operation of the projection system 1 in the fifth embodiment, and FIG. 23 is an explanatory diagram showing the transition of the projection state in the fifth embodiment. In the fifth embodiment, the configuration of the projection system 1 is the same as the configurations described in the first to fourth embodiments, and therefore illustration and description thereof will be omitted.

[0158] In the operation shown in FIG. 22, steps S41 and S71-S78 are common to those in FIG. Following step S78, the control device 10 displays a stereoscopic image based on the three-dimensional shape data. That is, the control device 10 causes the projector 2 to project an image and the screen forming device 3 to form a screen. The operations described below may be performed by the projection control unit 15 controlling the projector 2 and the screen forming device 3. Alternatively, the projection control unit 15 may transmit data required for display processing to the projector 2 and the screen forming device 3, and the second control unit 201 and the third control unit 301 may each perform the processing.

[0159] Under the control of the control device 10, the head driving unit 302 sets the nozzle row 34 at position Xa, which is the start position, among the nozzle rows 34 of the ejection head 31 aligned in the X-axis direction (step S91). The head driving unit 302 starts an operation of ejecting droplets DP three times in succession from the nozzles 33 constituting the nozzle row 34 at the set start position (step S92). The ejection interval of the droplets DP is preset corresponding to the time it takes for the droplets DP to descend between Z1 and Z2.

[0160] Meanwhile, in parallel with step S92, the projector 2 projects an image of line segment shape data of the Z coordinate corresponding to the nozzle row Xa at the timing when the screen is formed by the droplets DP discharged from the nozzles 33 (step S93). In step S93, the projector 2 simultaneously projects an image of one line segment shape data corresponding to the Z coordinate of the droplets DP. The droplets DP discharged from the nozzles 33 in the operation from step S92 are arranged in a maximum of three rows in the Z axis direction. The projector 2 projects an image of one line segment shape data onto one row of droplets DP located in the center in the Z axis direction among the rows of multiple droplets DP lined up in the Z axis direction.

[0161] Here, the control device 10 determines whether or not there is cross-sectional shape data 18A corresponding to the nozzle row 34 next to the Xa position set in step S91, i.e., the nozzle row 34 at the Xa+1 position (step S94). If there is no corresponding cross-sectional shape data 18A (step S94; NO), this process ends.

[0162] If there is cross-sectional shape data 18A corresponding to the nozzle row 34 at the Xa+1 position (step S94; YES), the screen forming device 3 starts the operation of discharging droplets DP from the nozzle row 34 at the Xa+1 position (step S95). In step S95, the screen forming device 3 starts the operation of discharging droplets DP three times in succession from the nozzle row 34 at the Xa+1 position at a timing delayed from the nozzle row 34 at the Xa position that started discharging in step S92. The projector 2 projects an image of the line segment shape data of the Z coordinate corresponding to the nozzle row Xa+1 at the timing when the screen is formed by the droplets DP discharged from the nozzle 33 (step S95). In step S95, the projector 2 projects an image of one line segment shape data onto the droplets DP of multiple rows aligned in the Z axis direction, similar to step S93.

[0163] The control device 10 adds +1 to the value of Xa, which indicates the position of the nozzle row 34 (step S97), and determines whether or not there is cross-sectional shape data 18A corresponding to the nozzle row 34 at the Xa+1 position, based on the incremented Xa (step S98). If there is no corresponding cross-sectional shape data 18A (step S98; NO), this process ends. If there is cross-sectional shape data 18A corresponding to the nozzle row 34 at the Xa+1 position (step S98; YES), the control device 10 proceeds to step S95.

[0164] 21, Fig. 23 is a front view of the ejection space 30A as seen in the X-axis direction, and shows the YZ plane located at the X coordinate of the nozzle row 34. The symbols PD, PP, and PR in Fig. 23 indicate the same things as in Fig. 17.

[0165] Fig. 23(a) shows the display state of a planar image FP1, Fig. 23(b) shows the display state of a planar image FP2, and Fig. 23(c) shows the display state of a planar image FP3. Times t1, t2, ..., t11 in Fig. 23(a), (b), and (c) are common. That is, Fig. 23(a), (b), and (c) show the display states of planar images FP1, FP2, and FP3 displayed on the YZ plane of different X coordinates during a common period from time t1 to t11.

[0166] In the example of FIG. 23, droplets DP are ejected three times in succession from all nozzles 33 included in the nozzle row 34 of the X coordinate corresponding to the planar image FP1. The projector 2 projects an image based on the line segment shape data corresponding to the Z coordinate of the droplets DP. Here, the projector 2 projects an image based on the line segment shape data onto one row of droplets DP located at the center in the Z axis direction among three rows of droplets DP aligned in the Z axis direction. That is, at time t2, the projector 2 projects an image of the line segment shape data corresponding to the Z coordinate Z1, and at time t3, projects an image of the line segment shape data corresponding to the Z coordinate Z2. The same operation continues until time t6 when the central droplet DP is located at the Z coordinate Z5 of the lowest row.

[0167] Furthermore, as shown in FIG. 23(b), at time t3, the screen forming device 3 starts discharging droplets DP from the nozzle row 34 at the X coordinate of the screen corresponding to the flat image FP2. The projector 2 projects image light PL onto the droplet DP at position Z1 at the timing when the droplet DP discharged from the nozzle row 34 reaches position Z2. After this, until time t8, the projector 2 projects an image onto the droplet DP at the X coordinate corresponding to the planar image FP2.

[0168] 23(c), at time t5, the screen forming device 3 starts discharging droplets DP from the nozzle row 34 at the X coordinate of the screen corresponding to the planar image FP3. The projector 2 projects image light PL onto the central droplet DP in the Z axis direction among the three rows of droplets DP discharged from the nozzle row 34. After this, until time t10, the projector 2 projects an image onto the droplet DP at the X coordinate corresponding to the planar image FP3.

[0169] 23, droplets DP that become screens onto which the flat images FP1, FP2, and FP3 are projected are discharged from the nozzle 33 at different timings. The projector 2 projects the flat images FP1, FP2, and FP3 at positions that are offset in the Z-axis direction. This allows the flat images FP1, FP2, and FP3 to be projected onto appropriate X coordinates.

[0170] According to the fifth embodiment, the same effects as those of the first to fourth embodiments can be obtained. Furthermore, the projector 2 projects an image smaller than the size in the Y-axis direction of the screen at the first height position, in accordance with the first height position in the Z-axis direction of the screen. For example, at time t2, an image smaller than the size Y1-Y5 in the Y-axis direction of the droplet DP at position Z1 is projected, so that an image based on the cross-sectional shape data 18A can be projected without protruding from the droplet DP. This allows a clear three-dimensional image TP to be projected onto the screen formed by the droplet DP.

[0171] [6. Sixth Embodiment] FIG. 24 is a flowchart showing the operation of the projection system 1 in the sixth embodiment, and FIG. 25 is an explanatory diagram showing the transition of the projection state in the sixth embodiment. In the sixth embodiment, the configuration of the projection system 1 is the same as the configurations described in the first to fifth embodiments, and therefore illustration and description thereof will be omitted.

[0172] In the operation shown in FIG. 24, steps S41 and S71-S78 are common to FIG. Following step S78, the control device 10 displays a stereoscopic image based on the three-dimensional shape data. That is, the control device 10 causes the projector 2 to project an image and the screen forming device 3 to form a screen. The operations described below may be performed by the projection control unit 15 controlling the projector 2 and the screen forming device 3. Alternatively, the projection control unit 15 may transmit data required for display processing to the projector 2 and the screen forming device 3, and the second control unit 201 and the third control unit 301 may each perform the processing.

[0173] Under the control of the control device 10, the head driving unit 302 sets the nozzle row 34 at position Xa, which is the start position, among the nozzle rows 34 of the ejection head 31 aligned in the X-axis direction (step S101). The head driving unit 302 starts an operation of ejecting droplets DP twice in succession from the nozzles 33 constituting the nozzle row 34 at the set start position (step S102). The ejection interval of the droplets DP is preset corresponding to the time it takes for the droplets DP to descend between Z1 and Z2.

[0174] Meanwhile, in parallel with step S102, the projector 2 projects an image of line segment shape data of the Z coordinate corresponding to the nozzle row Xa at the timing when the screen is formed by the droplets DP discharged from the nozzles 33 (step S103). In step S103, the projector 2 simultaneously projects two images of line segment shape data corresponding to the Z coordinates of the droplets DP. The droplets DP discharged from the nozzles 33 in the operation from step S102 are in one or two rows in the Z axis direction, and the projector 2 projects an image of one or two line segment shape data onto the droplets DP lined up in the Z axis direction.

[0175] Here, the control device 10 determines whether or not there is cross-sectional shape data 18A corresponding to the nozzle row 34 next to the Xa position set in step S101, i.e., the nozzle row 34 at the Xa+1 position (step S104). If there is no corresponding cross-sectional shape data 18A (step S104; NO), this process ends.

[0176] If there is cross-sectional shape data 18A corresponding to the nozzle row 34 at the Xa+1 position (step S104; YES), the screen forming device 3 starts the operation of discharging droplets DP from the nozzle row 34 at the Xa+1 position (step S105). In step S105, the screen forming device 3 starts the operation of discharging droplets DP three times in succession from the nozzle row 34 at the Xa+1 position at a timing delayed from the nozzle row 34 at the Xa position that started discharging in step S102. The projector 2 projects an image of the line segment shape data of the Z coordinate corresponding to the nozzle row Xa+1 at the timing when the screen is formed by the droplets DP discharged from the nozzle 33 (step S105). In step S105, the projector 2 projects one or two images of line segment shape data onto one or two rows of droplets DP aligned in the Z axis direction, similar to step S103.

[0177] The control device 10 adds +1 to the value of Xa, which indicates the position of the nozzle row 34 (step S107), and determines whether or not there is cross-sectional shape data 18A corresponding to the nozzle row 34 at the Xa+1 position, based on the incremented Xa (step S108). If there is no corresponding cross-sectional shape data 18A (step S108; NO), this process ends. If there is cross-sectional shape data 18A corresponding to the nozzle row 34 at the Xa+1 position (step S108; YES), the control device 10 proceeds to step S105.

[0178] 21 and 23, Fig. 25 is a front view of the ejection space 30A as seen in the X-axis direction, and shows the YZ plane located at the X coordinate of the nozzle row 34. The symbols PD, PP, and PR in Fig. 23 indicate the same things as in Fig. 17.

[0179] Fig. 25(a) shows the display state of a planar image FP1, Fig. 25(b) shows the display state of a planar image FP2, and Fig. 25(c) shows the display state of a planar image FP3. Times t1, t2, ..., t11 in Fig. 25(a), (b), and (c) are common. That is, Fig. 25(a), (b), and (c) show the display states of planar images FP1, FP2, and FP3 displayed on the YZ plane of different X coordinates during a common period from time t1 to t11.

[0180] In the example of FIG. 25, droplets DP are ejected twice in succession from all nozzles 33 included in the nozzle row 34 of the X coordinate corresponding to the planar image FP1. The projector 2 projects an image of the line segment shape data corresponding to the Z coordinate of the droplets DP. Here, the projector 2 projects an image based on the line segment shape data onto one or two rows of droplets DP aligned in the Z axis direction. That is, at time t1, the projector 2 projects an image of the line segment shape data corresponding to the Z coordinate Z1, and at time t2, projects images of two line segment shape data corresponding to the Z coordinates Z1 and Z2. The same operation continues until time t6 when the central droplet DP is located at the Z coordinate Z5 of the bottom row.

[0181] Furthermore, as shown in FIG. 25(b), at time t3, the screen forming device 3 starts discharging droplets DP from the nozzle row 34 at the X coordinate of the screen corresponding to the flat image FP2. The projector 2 projects image light PL onto the droplet DP at position Z1 of the droplet DP discharged from the nozzle row 34, and projects an image onto the droplet DP at the X coordinate corresponding to the planar image FP2 until time t8.

[0182] 25(c), at time t6, the screen forming device 3 starts discharging droplets DP from the nozzle array 34 at the X coordinate of the screen corresponding to the flat image FP3. The projector 2 projects image light PL onto the two rows of droplets DP discharged from the nozzle array 34. After this, until time t11, the projector 2 projects an image onto the droplets DP at the X coordinate corresponding to the flat image FP3.

[0183] According to the sixth embodiment, the same effects as those of the first to fifth embodiments can be obtained. Furthermore, according to the sixth embodiment, droplets DP that become the screen for projecting the planar images FP1, FP2, and FP3 are discharged from the nozzle 33 in up to two rows at different timings. The projector 2 projects the planar image FP1, the planar image FP2, and the planar image FP3 at positions shifted in the Z-axis direction. Therefore, the planar images FP1, FP2, and FP3 can be projected at appropriate X coordinates. Here, the projector 2 projects images based on up to two rows of line segment shape data, so that the amount of information of the afterimage visually recognized by the user can be increased, and a three-dimensional image TP with a richer three-dimensional feeling can be projected.

[0184] [7. Seventh embodiment] Here, a seventh embodiment to which the present invention is applied will be described. In the projection system 1 according to the seventh embodiment, the screen forming device 3 is capable of adjusting the size of the droplets DP discharged from the nozzle 33. In other words, the amount of liquid per droplet DP discharged from the nozzle 33 can be set in at least a plurality of stages. This configuration can be realized by making the mechanism for squeezing the liquid from the nozzle 33 controllable by the third control unit 301. Except for this configuration, the configuration of the projection system 1 according to the seventh embodiment is common to the configurations described in the first to sixth embodiments, and therefore illustrations and descriptions of the common parts will be omitted.

[0185] FIG. 26 is a flowchart showing the operation of the projection system 1 in the seventh embodiment. The projection system 1 executes a process for enhancing the contour of the cross-sectional shape data 18A generated from the three-dimensional shape data 18. The operation shown in FIG. 26 is executed in place of the coordinate conversion process executed by the data generating unit 13 in step S41 described in the first to sixth embodiments.

[0186] The data generating unit 13 performs coordinate conversion of the cross-sectional shape data 18A to convert it into data of a planar image having Y coordinates and Y coordinates (step S111). As a result, the cross-sectional shape data 18A becomes data of a planar image in the YZ plane, for example, as shown in FIG. Here, the data generating unit 13 specifies the coordinates of the contour of the planar image on the YZ plane (step S112).

[0187] Here, the data generating unit 13 determines the method of adjusting the resolution of the contour of the cross-sectional shape data 18A to be either high resolution or low resolution (step S113). In step S113, a preset process of high resolution or low resolution or a process according to a user's operation is selected.

[0188] The data generating unit 13 determines the size of the droplet DP corresponding to the coordinates of the contour of the cross-sectional shape data 18A according to the determination in step S113 (step S114). The data generating unit 13 adds the coordinates of the contour of the cross-sectional shape data 18A and data specifying the size of the droplet DP corresponding to the contour to the cross-sectional shape data 18A that has been coordinate-converted in step S111 (step S115). Thereafter, the control device 10 proceeds to the process of step S42 or step S71.

[0189] When this data is used to execute the operations of the first to sixth embodiments, the screen forming device 3 discharges droplets DP of a size specified by the data added to the cross-sectional shape data 18A from the nozzles 33. As a result, the size of the droplets DP at positions corresponding to the contour of the cross-sectional shape data 18A becomes different from the size of the droplets DP discharged from the other nozzles 33. Therefore, even if the image light PL projected by the projector 2 does not change, the contour of the planar image FP can be emphasized and visually recognized by the user.

[0190] According to the seventh embodiment, the same effects as those of the first to sixth embodiments can be obtained. Furthermore, according to the seventh embodiment, the control device 10 extracts the contour of the image based on the cross-sectional shape data 18A from the coordinates of the cross-sectional shape data 18A. The screen forming device 3 forms a screen with the droplets DP by discharging the droplets DP in droplet form from the nozzles 33. The screen forming device 3 makes the size of the droplets DP discharged from the nozzles 33 corresponding to the contour of the image of the cross-sectional shape data 18A different from the size of the droplets DP discharged from the other nozzles 33. Therefore, the contours of the two-dimensional image FP can be emphasized and visually recognized by the user, and a three-dimensional image TP with a richer three-dimensional feel can be projected.

[0191] [8. Eighth embodiment] FIG. 27 is a perspective view showing an example of the configuration of a discharge head 51 according to the eighth embodiment. An ejection head 51 shown in the eighth embodiment is provided in the screen forming apparatus 3 in place of the ejection head 31. The ejection head 51 includes a plurality of nozzles 52. Like the nozzles 33, the nozzles 52 eject liquid by a liquid ejection mechanism (not shown) to form droplets DP. The ejection head 51 also has a plurality of nozzles 52 arranged in the X-axis direction and the Y-axis direction. Except for this configuration, the configuration of the projection system 1 in the eighth embodiment is common to the configurations described in the first to sixth embodiments, and therefore illustration and description of the common parts will be omitted.

[0192] The nozzle 52 is configured to discharge droplets DP in an oblique direction. That is, the droplets DP discharged from the discharge head 51 form a screen SC1 at a position shifted from the nozzle 52 in the X-axis direction, as shown in FIG.

[0193] 27 is applicable to each of the first to seventh embodiments, and has the same effect as the nozzle 33. Furthermore, the screen forming device 3 to which the discharge head 51 is applied can form a screen SC1 with droplets DP at a position away from the nozzle 52. Therefore, for example, the screen SC1 can be formed at a position aligned with the end of the discharge head 51, and a flat image FP can be projected onto it. In other words, the degree of freedom in the position to project the flat image FP can be increased.

[0194] [9. Ninth embodiment] FIG. 28 is a perspective view showing an example of the configuration of a discharge head 54 in the ninth embodiment. The ejection head 54 shown in the ninth embodiment is provided in the screen forming apparatus 3 in place of the ejection head 31. The ejection head 54 includes a plurality of nozzles 55. Like the nozzles 33, the nozzles 55 eject liquid by a liquid ejection mechanism (not shown) to form droplets DP. Except for this configuration, the configuration of the projection system 1 of the ninth embodiment is common to the configurations described in the first to sixth embodiments, and therefore illustration and description of the common parts will be omitted.

[0195] The discharge head 54 has a row of nozzles 55 aligned in the Y-axis direction. The nozzles 55 discharge droplets DP parallel to the X-axis direction or at an angle close to the X-axis direction. Therefore, as shown in Fig. 28, the droplets DP discharged from the discharge head 54 fly along a parabola and form screens SC21 and SC22 at positions offset from the nozzles 52 in the X-axis direction.

[0196] Here, if the discharge head 54 can switch the discharge pressure when discharging the droplets DP in multiple stages, the flight distance of the droplets DP changes depending on the discharge pressure. Therefore, the discharge head 54 forms the screens SC21 and SC22 at different positions in the X-axis direction depending on the discharge pressure.

[0197] 28 is applicable to each of the first to seventh embodiments, and has the same effect as the nozzle 33. Furthermore, the screen forming device 3 to which the discharge head 54 is applied can form the screens SC21, SC22 at different positions in the X-axis direction using a single row of nozzles 55. Therefore, even if the space for installing the discharge head 54 is limited, it is possible to form a plurality of screens SC21, SC22 using liquid and project a three-dimensional image TP.

[0198] [10. Tenth Embodiment] FIG. 29 is an explanatory diagram of the operation of the projection system 1 in the tenth embodiment. The configuration of the projection system 1 of the tenth embodiment is common to the configurations described in the first to sixth embodiments, and therefore illustration and description of the common parts will be omitted.

[0199] 29, the change in the operating state of the discharge head 31 projecting droplets DP is shown in chronological order by symbols (a)-(h). First, as shown in states (a)-(c), the screen forming device 3 sequentially selects the nozzle rows 34 in the positive direction of the X axis starting from the side closest to the origin of the X coordinate, and projects the droplets DP. In state (d), after discharging the droplets DP from the nozzle row 34 corresponding to the largest X coordinate, the screen forming device 3 discharges the droplets DP from the nozzle row 34 adjacent to the nozzle row 34 corresponding to the largest X coordinate, as shown in state (e). Thereafter, as shown in states (f)-(h), the screen forming device 3 sequentially selects the nozzle rows 34 in the negative direction toward the origin of the X coordinate, and discharges the droplets DP.

[0200] In this way, there is no restriction on the order in which the multiple nozzle rows 34 provided in the discharge head 31 are selected, and the nozzle rows may be selected from the smaller X coordinate to the larger X coordinate, or may be selected so as to go back and forth in the X-axis direction. Furthermore, the screen forming device 3 may select every other nozzle row 34 in the X-axis direction to discharge droplets DP. In any of these cases, the effects of the first to eighth embodiments described above can be obtained.

[0201] [11. Eleventh embodiment] FIG. 30 is a block diagram of a projection system 1A in the eleventh embodiment. In the configuration shown in FIG. 30, components common to the projection system 1 are given the same reference numerals and descriptions thereof will be omitted.

[0202] The projection system 1A includes a control device 10, a projector 2, and a screen forming device 3, and the control device 10 and the projector 2 are connected via a communication device 100. In addition, the projector 2 is connected to the screen forming device 3, but the screen forming device 3 is not directly connected to the control device 10.

[0203] The control device 10 executes the functions of a data acquisition unit 12, a data generation unit 13, and a matching processing unit 14. The control device 10 transmits three-dimensional shape data 18, cross-sectional shape data 18A, and matching processing data to the projector 2 via the communication device 100.

[0204] In the eleventh embodiment, the projector 2 has a configuration capable of executing the functions of the projection control unit 15 by a second control unit 201. The projector 2 controls the projection of an image by the projection unit 20, and also controls the formation of a screen by the screen forming device 3, i.e., the ejection of droplets DP by the screen forming unit 30.

[0205] According to the configuration of the eleventh embodiment, the control device 10 executes processes related to the generation of the cross-sectional shape data 18A and the coordinate conversion of the cross-sectional shape data 18A, and the projector 2 executes the subsequent processes. For example, the control device 10 executes the processes of steps S41-S46, S71-S78, and S111-S115, and transmits the process results through the communication device 100. In this case, the projector 2 executes the control of steps S47-S50, S55-S56, S61-S62, S79-S82, S91-S98, and S101-S108. This makes it possible to reduce the space required for installing the projector 2 and the screen forming device 3 that project images. In addition, the processes executed by the control device 10 can be executed in advance at a timing before the stereoscopic image TP is projected. This makes it possible to alleviate the time constraints required for the projection of the stereoscopic image TP.

[0206] In the projection system 1A, a portable semiconductor storage device may be used instead of the communication device 100. In this case, data required for projecting the stereoscopic image TP can be prepared without connecting the control device 10 and the communication device 100 to the projector 2.

[0207] [12. Twelfth Embodiment] FIG. 31 is a block diagram of a projection system 1B in the twelfth embodiment. In the configuration shown in FIG. 31, components common to the projection system 1 are given the same reference numerals and description thereof will be omitted.

[0208] The projection system 1B has a configuration in which the control device 10 of the projection system 1 is integrated into a projector 2A. In addition to the configuration of the projector 2, the projector 2A has a control device 10A.

[0209] The control device 10A has the functions of the control device 10 described above, and the first control unit 11 is connected to the second control unit 201. The control device 10A executes the functions of the control device 10 in each of the embodiments described above, and the projector 2A functions in the same manner as the projector 2.

[0210] According to the projection system 1B, the projector 2 also functions as the control device 10, so the space required for installing the projection system 1B can be reduced.

[0211] [13. Other embodiments] The above embodiment shows a specific example to which the present invention is applied, and the present invention is not limited to this. For example, in each of the above embodiments, an example has been described in which droplets DP are discharged downward from the discharge head 31, and a screen is formed by the descending droplets DP. The present invention is not limited to this, and for example, the discharge head 31 may be installed below the screen forming device 3, and the droplets DP may be sprayed upward to form a screen. The same applies to a configuration using the discharge heads 51 and 54.

[0212] In addition, in each of the above embodiments, the discharge head 31 discharges the droplets DP one by one, but the discharge head 31 may discharge the liquid continuously so as to draw a line. That is, the discharge head 31 may form a screen with the liquid on a line extending in the Z-axis direction. The same applies to the configuration using the discharge heads 51 and 54.

[0213] Furthermore, in each of the above embodiments, the image light PL projected by the projector 2 may be image light PL of a color image containing R, G, and B light components, but it may also be monochromatic light or light containing a specific color light. In each of the above embodiments, the image light PL may include light outside the visible region, such as ultraviolet light, infrared light, etc. In this case, for example, the liquid discharged by the screen forming device 3 may be a liquid including a component that emits fluorescence or phosphorescence in the visible region when irradiated with light outside the visible region contained in the image light PL.

[0214] Moreover, each functional unit shown in the block diagram of the projection system 1, 1A, 1B indicates a functional configuration, and does not limit the specific implementation form. For example, it is not necessarily necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Also, some of the functions realized by software in the above embodiment may be realized by hardware, or some of the functions realized by hardware may be realized by software. In addition, the specific detailed configuration of each other unit of the projector 2 can also be arbitrarily changed within the scope of the gist.

[0215] Furthermore, the processing units in the flowcharts showing the operations of the projection systems 1, 1A, and 1B are divided according to the main processing contents in order to make the invention easier to understand. The present invention is not limited by the manner in which the processing units are divided or the names thereof shown in the flowcharts. Furthermore, the processing of the projection systems 1, 1A, and 1B can be divided into more processing units according to the processing contents, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the figures. [Explanation of symbols]

[0216] 1, 1A, 1B...projection system, 2, 2A...projector (projection device), 3...screen forming device, 4...image source, 10, 10A...control device, 11...first control unit, 12...data acquisition unit, 13...data generation unit, 14...matching processing unit, 15...projection control unit, 16...interface unit, 17...first memory unit, 18...three-dimensional shape data, 18A...cross-sectional shape data, 20...projection unit, 21...light source, 22...light modulation device, 23...projection optical system, 30...screen forming unit, 30A...ejection space, 31...ejection head, 31A...nozzle arrangement surface, 32...recovery unit, 33...nozzle, 34, 34a , 34b...nozzle row, 35...liquid recovery system, 36...head control unit, 37A...first reflecting unit, 37B...second reflecting unit, 51, 54...ejection head, 52, 55...nozzle, 100...communication device, 201...second control unit, 207, 207A, 207B...distance measuring unit, 221...panel, 301...third control unit, 302...head driving unit, 303...pump driving unit, 304...liquid volume detection unit, 305...droplet sensor, 305A...first droplet sensor, 305B...second droplet sensor, 351...liquid supply pipe, 352...recovery pipe, 353, 354...pump, 355...sub tank, 356...main tank, 357...pipe.

Claims

1. A projection system for projecting image light onto a screen, comprising: a screen forming device having a plurality of nozzles and forming the screen by discharging liquid from the nozzles onto an optical path of the image light; a projection device including a light source and a light modulation device that modulates light emitted by the light source to form the image light, and projects the image light onto the screen; a data generating unit that divides three-dimensional shape data to generate cross-sectional shape data, and a control device that controls the projection device and the screen forming device based on the cross-sectional shape data, the nozzles of the screen forming device are arranged side by side on an X-Y plane along an X-axis, which is a direction in which the screens corresponding to the cross-sectional shape data overlap, and a Y-axis direction intersecting the X-axis; the light modulation device of the projection device has a configuration in which an image is formed using a plurality of pixels and light emitted from the light source is modulated by the pixels; the control device includes a matching processing unit that associates coordinates of the cross-sectional shape data, coordinates of the pixels of the projection device, a nozzle of the screen forming device, and a height of a discharge space from the nozzle in a Z-axis direction perpendicular to the XY plane; the data generation unit of the control device generates line segment shape data by dividing the cross-sectional shape data in the Z-axis direction; the screen forming device drives the nozzles in units of a nozzle row including a plurality of the nozzles aligned in the Y-axis direction, and ejects the liquid from the plurality of nozzle rows corresponding to the plurality of cross-sectional shape data with a time difference for each of the nozzle rows, thereby forming the screen by shifting the height in the Z-axis direction for each of the nozzle rows; the projection device projects an image based on the line segment shape data of the cross-sectional shape data corresponding to each of the screens in accordance with a height of the screen in the Z-axis direction; Projection system.

2. The projection system according to claim 1 , wherein the data generating section generates the cross-sectional shape data of a cross section perpendicular to the X-axis by dividing the three-dimensional shape data in an X-axis direction.

3. A projection system as described in claim 1 or 2, wherein the matching processing unit associates the coordinates of the line segment shape data, the coordinates of the pixel of the projection device, the nozzle of the screen forming device, and the height of the ejection space from the nozzle in the Z-axis direction.

4. The screen forming device includes: forming one of the screens by the liquid ejected from one of the nozzle rows; 4. The projection system according to claim 1, wherein the liquid is ejected from a plurality of nozzle rows corresponding to a plurality of cross-sectional shape data with a time difference, and before one of the screens is formed, formation of another screen is started.

5. The projection system according to claim 4 , wherein the screen forming device forms the linear screen having a unit height in the Z-axis direction by the liquid ejected from the nozzle row.

6. The projection system according to claim 5 , wherein the projection device projects a linear image in accordance with a height of the linear screen in the Z-axis direction.

7. 7. The projection system according to claim 6, wherein the projection device projects the image, aligned with a first height position in the Z-axis direction of the screen, the image being smaller than the size of the screen at the first height position in the Y-axis direction.

8. The control device extracts a contour of an image based on the cross-sectional shape data from the coordinates of the cross-sectional shape data, The screen forming device includes: The liquid is discharged from the nozzle in the form of droplets to form the screen using the droplets; 8. The projection system according to claim 1, wherein a size of the droplets ejected from the nozzle corresponding to a contour of an image of the cross-sectional shape data is made different from a size of the droplets ejected from the other nozzles.

9. A control device used in combination with a projection device that projects image light, and a screen forming device that forms a screen by ejecting liquid from a plurality of nozzles onto an optical path of the image light, comprising: a data generating unit that acquires three-dimensional shape data configured in a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis that are orthogonal to each other, and divides the three-dimensional shape data to generate cross-sectional shape data; a matching processing unit that associates the coordinates of the cross-sectional shape data, pixels at which the projection device draws an image, the nozzle of the screen forming device, and a height in an ejection space of the liquid ejected from the nozzle, the data generation unit generates line segment shape data by dividing the cross-sectional shape data in the Z-axis direction; controlling the screen forming device to drive the nozzles in units of a nozzle row including a plurality of the nozzles aligned in the Y-axis direction, and ejecting the liquid from the plurality of nozzle rows corresponding to the plurality of cross-sectional shape data with a time difference for each of the nozzle rows, thereby forming the screen by shifting the height in the Z-axis direction for each of the nozzle rows; controlling the projection device to project an image based on the line segment shape data of the cross-sectional shape data corresponding to each of the screens in accordance with the height of each of the screens in the Z-axis direction; Control device.

10. 1. An image projection method for projecting an image using a screen forming device that forms a screen by ejecting liquid from a plurality of nozzles, and a projection device that draws an image using a plurality of pixels and projects image light modulated by the pixels onto the screen, comprising: Acquire three-dimensional shape data configured in a three-dimensional coordinate system having an X-axis, a Y-axis, and a Z-axis that are orthogonal to each other; Dividing the three-dimensional shape data in the X-axis direction to generate cross-sectional shape data; generating line segment shape data by dividing the cross-sectional shape data in the Z-axis direction; The coordinates of the line segment shape data are obtained; executing a matching process for associating the coordinates of the line segment shape data, the coordinates of the pixel of the projection device, the nozzle of the screen forming device, and the height of a discharge space from the nozzle in the Z-axis direction; An image projection method comprising: driving the pixels and the nozzles of the screen forming device, which are driven in units of nozzle rows including a plurality of the nozzles aligned in the Y-axis direction, based on the cross-sectional shape data and in accordance with the association made by the matching process; ejecting the liquid from a plurality of the nozzle rows corresponding to a plurality of the cross-sectional shape data with a time difference for each nozzle row; forming the screen by shifting the height in the Z-axis direction for each nozzle row; and projecting an image based on the line segment shape data of the cross-sectional shape data corresponding to the screen, in accordance with the height in the Z-axis direction of each of the screens.

Citation Information

Patent Citations

  • Stereoscopic picture reproducing device

    JP1995154830A

  • Video display apparatus

    JP2008033202A

  • Screen formation device, projection system and screen formation method

    JP2015121655A

  • Virtual sports simulation device

    US20200206597A1

  • Program controllable free falling water drop fountain

    US4294406A