Projection control device, space projection device, space projection system and space projection method

By setting up a acquisition and correction unit in the projection device, using the DLP method and light guide optical system, the problem of image deformation in the prior art is solved, and spatial projection with high brightness and clarity is realized to adapt to projection requirements of different shapes and angles. .

CN115086624BActive Publication Date: 2024-12-03CASIO COMPUTER CO LTD
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
CN202210235702.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-03-11
Filing Date
2022-03-11
Publication Date
2024-12-03
Estimated Expiration
2042-03-11

AI Technical Summary

Technical Problem

It is difficult for existing spatial projection technology to achieve high visual effects when maintaining poor images, especially when the image shape and angle change, the projected light is easily deformed, affecting the visual effect.

Method used

By providing a acquisition unit and a correction unit in the projection device, the projection light re-imaged by the light guide optical system in the spatial imaging unit is obtained and corrected, so as to ensure that the projected image maintains the expected shape and brightness on the imaging medium, the projection device adopts the DLP method. and light guide optical systems, including beam splitters and retroreflective components, achieve high brightness spatial projection.

Benefits of technology

It realizes high-visual spatial projection without any adverse conditions in the image, can adapt to projection needs of different shapes and angles, improves the brightness and clarity of the projected light, and simplifies the overall structure.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115086624B_ABST
    Figure CN115086624B_ABST
Patent Text Reader

Abstract

Provided are a projection control device, a spatial projection device, a spatial projection system and a spatial projection method capable of realizing spatial projection with high visual effects without defects in the image. The projection control device comprises: an acquisition unit that acquires information related to a first projection image (2a) projected by a projection device (10) and imaged on an imaging medium (20); and a correction unit that corrects information of a second projection image (2a) imaged on an imaging medium (20) as projection light re-imaged in a spatial imaging unit (40) through a light guide optical system (30) based on the acquired information related to the first projection image (2a).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority based on Japanese Patent Application No. 2021-038823 filed on March 11, 2021, the contents of which are cited herein. Technical Field

[0002] The invention relates to a projection control device, a space projection device, a space projection system and a space projection method. Background Art

[0003] In the past, space projection technology for projecting by imaging projection light in space has been disclosed. For example, Japanese Patent Publication No. 2006-317708 discloses an aerial floating image projection device that projects an image into space by arranging a projection object such as a display image or a real object in a lower chamber and comprising a first Fresnel lens, a beam splitter, a surface reflector, and a second Fresnel lens. Summary of the invention

[0004] In a structure that uses a display image or a real object as a projection object and guides light using a beam splitter or a surface reflector as in Patent Document 1, it is sometimes impossible to project a spatial projection image in an arbitrary shape without causing problems such as deformation in the image.

[0005] An object of the present invention is to provide a projection control device, a space projection device, a space projection system, and a space projection method that can perform space projection with high visual effects without defects in images.

[0006] A projection control device comprises: an acquisition unit for acquiring information related to a first projection image projected by a projection device and imaged on an imaging medium; and a correction unit for correcting information related to the first projection image obtained, which is a second projection image imaged on the imaging medium as projection light re-imaged in a spatial imaging unit through a light-guiding optical system.

[0007] A spatial projection device comprises: a projection device; an acquisition unit for acquiring information related to a first projection image projected by the projection device and imaged on an imaging medium; and a correction unit for correcting information on a second projection image imaged on the imaging medium as projection light re-imaged in a spatial imaging unit by a light-guiding optical system, based on the acquired information related to the first projection image.

[0008] A spatial projection system comprises: a projection device; an acquisition unit for acquiring information related to a first projection image projected by the projection device and imaged on an imaging medium; and a correction unit for correcting information related to a second projection image imaged on the imaging medium as projection light re-imaged on a spatial imaging unit by a light guiding optical system based on the acquired information related to the first projection image.

[0009] A spatial projection method, which obtains information related to a first projection image projected by a projection device and imaged on an imaging medium; based on the obtained information related to the above-mentioned first projection image, corrects information related to a second projection image imaged on the above-mentioned imaging medium as projection light re-imaged on a spatial imaging part by a light-guiding optical system, and projects the above-mentioned second projection image through the above-mentioned projection device.

[0010] According to the present invention, it is possible to provide a projection control device, a space projection device, a space projection system, and a space projection method capable of performing space projection with high visual effects without causing any problems in an image. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a schematic plan view of the space projection device according to Embodiment 1 of the present invention.

[0012] Figure 2 It is a diagram showing the configuration of a projection device and an imaging device according to Embodiment 1 of the present invention.

[0013] Figure 3 It is a schematic plan view of a space projection device in which an arc-shaped imaging medium is arranged according to Embodiment 1 of the present invention.

[0014] Figure 4 This is a flowchart showing the operation of the space projection device according to the first embodiment of the present invention.

[0015] Figure 5A to Figure 5C is a diagram showing a correction image according to the first embodiment of the present invention. Figure 5A to Figure 5C This is a correction image for correcting deformation.

[0016] Figure 6 This is a flowchart showing the operation of the space projection device according to the second embodiment of the present invention.

[0017] Figure 7 It is a schematic plan view of a space projection device having a light guiding optical system that can be applied to each embodiment of the present invention.

[0018] Figure 8 It is a schematic plan view showing another configuration example of the space projection device that can be applied to each embodiment of the present invention. DETAILED DESCRIPTION

[0019] (Implementation Method 1)

[0020] Hereinafter, embodiments for carrying out the present invention will be described. Figure 11 is a schematic plan view of a space projection device 100 in the space projection system 1. The space projection device 100 includes a projection device 10 (projector, projection control device), an imaging medium 20 irradiated with projection light P1 emitted from the projection device 10, a light guide optical system 30 for guiding light projected onto the imaging medium 20, a space imaging unit 40 for re-imaging the light guided by the light guide optical system 30, and a photographing device 80 for photographing the projection image 2a projected onto the imaging medium 20. In the space projection device 100, the projection image 2a emitted from the projection device 10 and imaged onto the imaging medium 20 diffuses and transmits through the imaging medium 20 and enters the light guide optical system 30, and is re-imaged into the space imaging unit 40 by the light guide optical system 30, so that the viewer 50 can visually recognize the space projection image 4a floating in the air.

[0021] The projection image 2a projected by the projection device 10 has a shape different from the original image data ( Figure 2 In order to appropriately visually recognize the spatial projection image 4a from the viewer 50, the processing unit 12 corrects the projection image 112. The image correction information 111, 841 (see FIG. 84) is obtained based on the deviation between the correction image 70 projected by the projection device 10 and the correction image 70 in the captured image 60 captured by the camera 80. Figure 2 ) is corrected. Therefore, the projection device 10 can project an image so that the original projection image 112 is visually recognized in an expected form for the viewer 50 based on the image correction information 111.

[0022] Reference Figure 2 The structures of the projection device 10 and the imaging device 80 are described. The projection device 10 includes a storage unit 11, a processing unit 12, a projection unit 13, an operation unit 14, a communication unit 15 (acquisition unit), and a sound processing unit 16, which are connected via an internal bus. The storage unit 11 is composed of, for example, an SSD (Solid State Drive) or an SRAM (Static Random Access Memory). In the storage unit 11, data such as correction images 70 (70a to 70c), image correction information 111, a projection image 112 (including image data or dynamic image data) as an image for viewing, and a control program are stored. The processing unit 12 is composed of a CPU, a microcomputer, etc., and reads out the control program stored in the storage unit 11 to control the projection device 10.

[0023] The projection unit 13 forms an image of the projection image 112 sent from the processing unit 12 at a frame rate according to a preset image format, and emits the image as projection light P1 to the outside. The projection device 10 of the present embodiment is a DLP (Digital Light Processing) projection device. The projection unit 13 irradiates the blue band light, green band light and red band light emitted by the internal light source device to the DMD (digital micromirror device) as a display element, and the DMD reflects the blue band light, green band light and red band light in a time-sharing manner for each micromirror (or each pixel) to form a colored image light. The image light is emitted to the outside as the projection light P1 of the projection device 10 via the projection lens in the projection unit 13. The projection light P1 (image light) emitted from the projection unit 13 is projected toward Figure 1 The imaging medium 20 is projected.

[0024] The operation unit 14 receives an operation signal from an operation key or the like provided on the housing of the projection device 10, and transmits the operation signal to the processing unit 12 via the bus. The processing unit 12 executes various functions such as projection processing according to the operation signal from the operation unit 14.

[0025] The communication unit 15 wirelessly receives an operation signal based on an infrared modulation signal or the like from a remote controller (not shown), and transmits the operation signal to the processing unit 12. In addition, the communication unit 15 is connected to the communication unit 85 of the imaging device 80 by a wired cable 101, and can transmit and receive data. The communication unit 15 may also include an external input terminal, and image data can be input from an external device.

[0026] The sound processing unit 16 includes a sound source circuit such as a PCM sound source, and drives the speaker 17 to diffuse and emit sound. When the projected image data includes a sound signal, the sound processing unit 16 converts the sound signal into analog form during the projection operation and outputs the sound through the speaker 17.

[0027] The imaging device 80 includes an imaging unit 81, a processing unit 82, an input / output control unit 83, a storage unit 84, and a communication unit 85, which are connected via an internal bus. Figure 1 The projected image 2a of the imaging medium 20.

[0028] The processing unit 82 has a function of controlling the imaging device 80, and is composed of a CPU, a microcomputer, etc. The processing unit 82 analyzes the captured image 60 including the correction image 70 captured by the imaging unit 81. The processing unit 82 sends the analysis result of the correction image 70 to the projection device 10 via the communication unit 85 as image correction information 841. In addition, the processing unit 82 sends a projection instruction 85a to the projection device 10 via the communication unit 85 based on the analysis result of the captured image 60.

[0029] The input / output control unit 83 sends information corresponding to the operation instruction inputted from the viewer 50 or the like through the operation key 831 to the processing unit 82. The display device 832 is a screen, a display lamp, etc. that displays the image outputted from the input / output control unit 83. The storage unit 84 stores the control program of the imaging device 80, the image 60 captured by the imaging unit 81, the image correction information 841, etc.

[0030] Back to Figure 1 The imaging medium 20 has an arbitrary shape and size that includes the projection range of the projection light P1. Alternatively, the imaging medium 20 is disposed at an arbitrary position that includes the projection range of the projection light P1. Figure 1 The imaging medium 20 is configured as a transmissive film in a flat plate or film shape. The imaging medium 20 is a transmissive component that diffuses and emits spatial projection light P2 (including light L2) toward the light guide optical system 30 from the second surface 22 side, which is the opposite side of the first surface 21, when the projection light P1 (including light L1) emitted from the projection device 10 is irradiated to the first surface 21 side of the projection device 10.

[0031] The light guide optical system 30 is disposed on the second surface 22 side of the imaging medium 20 and includes a beam splitter 31 and a retroreflective component 32 (retroreflective mirror). The retroreflective component 32 is disposed on the configuration surface S (including the imaging medium 20) of the imaging medium 20. Figure 1 The beam splitter 31 is configured perpendicularly to the Y direction (front-back direction) and Z direction (up-down direction) of the imaging medium 20. In addition, the beam splitter 31 is formed in a flat plate shape and is configured at an angle of 45 degrees relative to the configuration surface S of the imaging medium 20 and the retroreflective component 32. The beam splitter 31 of this embodiment is a half mirror that reflects a part of the incident light and transmits the other part. The retroreflective component 32 has a mirror surface that reflects the incident light in the opposite direction to the incident direction.

[0032] The spatial imaging unit 40 is a spatial region where the projection image 2a projected onto the imaging medium 20 is emitted as spatial projection light P2 (P3) and then re-imaged by the light guide optical system 30 to display a spatial projection image 4a.

[0033] Next, the spatial projection method of the spatial projection device 100 (spatial projection system 1) is described. The projection device 10 irradiates light to the imaging medium 20 from an inclined direction that is inclined relative to the optical axis of the entire projection light P1 and the normal direction (X direction) of the imaging medium 20. Light L1 emitted from a point light source (an arbitrary point on the micromirror in the DMD (display element)) in the projection device 10 (in the projection unit 13) via a projection lens is imaged at an imaging point F1 on the imaging medium 20. The imaging medium 20 is irradiated with light emitted from the point light source in the projection device 10 and imaged along the optical path illustrated by the light L1 in the irradiation range of the projection light P1. As a result, a projection image 2a is projected onto the imaging medium 20.

[0034] Light of any point constituting the projected image 2a formed on the imaging medium 20 is diffused and transmitted from the second surface 22 at a predetermined diffusion angle and emitted. For example, the above-mentioned light L1 imaged at the imaging point F1 is diffused as light L2 at a predetermined diffusion angle and enters the beam splitter 31. A part of the light L2 is reflected by the beam splitter 31 toward the retroreflective component 32. That is, the light L2 emitted from the point light source of the projected image 2a is guided as diffused light in the optical path from the imaging medium 20 to the retroreflective component 32. The retroreflective component 32 reflects the incident light in the opposite direction to the incident direction, so the light L2 incident on the retroreflective component 32 is reflected toward the beam splitter 31 as convergent light that is focused at the same angle as the diffusion angle. The light L3 reflected by the retroreflective component 32 partially transmits through the beam splitter 31 and is guided toward the spatial imaging unit 40. And, in the spatial imaging unit 40, the light L3 is imaged again at the imaging point F2. In addition, the optical path length of the light L2 and the optical path length of the light L3 are substantially the same.

[0035] Then, the light L3 formed on the imaging point F2 of the spatial imaging unit 40 is guided as the light L4 having the same diffusion angle as the focusing angle of the light L3 and the diffusion angle of the light L2 .

[0036] The light L1 to L4 from the point light sources of the display element in the projection device 10 as described above are guided into the effective area of ​​the optical path of the imaging medium 20 and the light guiding optical system 30. That is, the projection light P1, which is a collection of the light L1 from the point light sources emitted from the projection device 10, is irradiated from the first surface 21 side of the imaging medium 20 and imaged in the imaging medium 20. The projection light P1 irradiated onto the imaging medium 20 is emitted from the second surface 22 to the beam splitter 31 side as the collection of the light L2, that is, the spatial projection light P2. A portion of the spatial projection light P2 irradiated onto the beam splitter 31 is reflected toward the retroreflective component 32 side. The retroreflective component 32 reflects the spatial projection light P2 guided from the beam splitter 31 side as the spatial projection light P3 (the collection of the light L3). A portion of the spatial projection light P3 reflected by the retroreflective component 32 is transmitted through the beam splitter 31 and guided toward the spatial imaging unit 40 side.

[0037] In this way, the light (a collection of point light sources) constituting the projection image 2a formed on the imaging medium 20 is re-imaged on the spatial imaging unit 40 as the spatial projection surface, and is emitted toward the viewer 50. Therefore, the viewer 50 can visually recognize the spatial projection image 4a formed in the air on the spatial imaging unit 40. In addition, the viewer 50 can visually recognize the spatial projection image 4a even if the observation point is moved. For example, the light L4 emitted from the imaging point F2 can be Figure 1 The position within the diffusion angle range (within the emission angle range) of the light L4 shown is visually recognized.

[0038] In addition, the directions of the up-down direction (Z direction) and the left-right direction (X direction) of the spatial projection image 4a observed from the viewer 50 side from the spatial imaging unit 40 side, that is, the direction A, are substantially the same as the up-down direction (Z direction) and the front-back direction (Y direction) of the projection image 2a observed from the direction B. On the other hand, the optical path lengths of the light L2 and the light L3 are substantially the same, so the depth position (depth position) of the spatial projection image 4a observed from the direction A is in an opposite relationship to the depth position of the projection image 2a observed from the direction B (in the direction A). Figure 3 (described later in this chapter) Figure 1 In the case where the imaging medium 20 is set to a flat state, the spatial projection image 4a is also displayed as a flat plane image.

[0039] Next, refer to Figure 3 , indicating that instead of Figure 1 The structure of the case where the arc-shaped imaging medium 20A is used instead of the imaging medium 20 shown in the figure. The degree of the concavity and convexity of the imaging medium 20A is configured to be limited within the depth of field of the projection light P1 (light L1) emitted from the projection device 10. Therefore, a focused projection image 2a (or a projection image 2a formed to a degree that can be regarded as focused) is displayed on the imaging medium 20A.

[0040] As described above, the optical path lengths of the light L2 and the light L3 guided by the light guiding optical system 30 are substantially the same, and the depth position of the spatial projection image 4a observed from the A direction is inversely related to the depth position of the projection image 2a observed from the B direction. Figure 3 As shown, the imaging point F1 on the rear side of the curved projection image 2a observed from the B direction corresponds to the imaging point F2 on the front side of the spatial projection image 4a observed from the A direction. Therefore, by forming the imaging medium 20A into a three-dimensional surface including concavities and convexities, the three-dimensional spatial projection image 4a can be projected onto the spatial imaging unit 40.

[0041] Next, use Figure 45 illustrates a method of correcting a projected image. The spatial projection device 100 captures a projection image 2a projected on the imaging medium 20, and obtains image correction information 111 (deformation parameters) used for correcting a projected image 112 based on the captured image 60. Figure 4 The following is a processing example of calculating the image correction information 111 before projecting the viewing projection image 112. When the processing unit 12 of the projection device 10 starts measuring the image correction information 111 (step S201), it projects the pattern of the correction image 70 onto the imaging medium 20 in step S202.

[0042] Figure 5A , Figure 5B as well as Figure 5C The figures respectively show correction images 70a to 70c for deformation correction. The correction images 70a, 70b and 70c have a checkerboard pattern in which substantially square white quadrilaterals and black quadrilaterals are alternately arranged in the longitudinal and transverse directions in the measurement image 72 covering substantially the entire surface. The correction images 70a to 70c can detect the deformation of the first surface 21 with different resolutions according to the size of the checkerboard pattern. The projection device 10 projects the correction images 70a to 70c onto the first surface 21 and causes a camera (not shown) to take the image. The camera can combine a plurality of correction images 70a to 70c to accurately detect the overall deformation of the first surface 21 of the imaging medium 20.

[0043] In this embodiment, the projection device 10 projects the correction image 70a of the large checkerboard pattern, the correction image 70b of the medium checkerboard pattern, and the correction image 70c of the small checkerboard pattern in this order onto the imaging medium 20. At this time, the corners of the quadrilaterals of the correction images 70a, 70b, and 70c of the checkerboard patterns of different sizes are arranged at positions where they do not overlap each other during projection.

[0044] In step S203, the processing unit 82 of the imaging device 80 acquires the correction image 70 (70a to 70c) to be projected by imaging the imaging unit 81 from the projection device 10 side. The imaging device 80 of this embodiment is provided as a separate device from the projection device 10.

[0045] In step S204, the processing unit 12 determines whether all the patterns of the correction images 70a to 70c have been projected and photographed by the camera 80. In addition, the processing unit 12 receives a notification indicating that the camera 80 has acquired all the photographed images 60 corresponding to the correction images 70 via the communication units 85 and 15, so that the determination of step S204 can be performed. When all the patterns of the correction images 70a to 70c have been projected and photographed ("Yes" in S204), the processing unit 12 proceeds to the processing of step S205, and when not all the patterns of the correction images 70 have been projected and photographed ("No" in S204), the processing unit 12 returns to the processing of step S202. In the present embodiment, the projection device 10 projects the correction images 70a to 70c in sequence until the projection and photographing of three correction images 70a to 70c are performed.

[0046] In step S205, the processing unit 82 of the imaging device 80 determines the position of each correction image 70a to 70c based on the position of the mark 71 detected from each captured image 60a to 60c (images obtained by respectively capturing the correction images 70a to 70c). Figure 5A to Figure 5C The correction images 70a to 70c shown are all provided with marks 71 at the same positions at the four corners of the images, so the camera detects the positional deviation of the parallel components and the rotational components of the correction images 70a to 70c by detecting the positional deviation of the marks 71 between the correction images 70a to 70c. The processing unit 82 detects the positional deviation of the plurality of correction images 70a to 70c and performs offset correction. Thus, the positional deviation between the captured images 60a to 60c caused by hand shaking or the like can be corrected. The processing unit 82 can detect the coordinates of the intersections (corners) of the checkerboard patterns in the correction images 70a to 70c in the captured images 60a to 60c and calculate the degree of deformation of the imaging medium 20. The camera 80 generates image correction information 841 based on the information on the degree of deformation.

[0047] Then, in step S206, the processing unit 82 causes the projection device 10 to obtain the obtained image correction information 841 via the communication units 15 and 85. The processing unit 12 of the projection device 10 stores the obtained image correction information 841 in the storage unit 11 as the image correction information 111, and can perform image correction processing on the projection image 112 (image data of content information) for viewing according to the image correction information 111. That is, the processing unit 12 functions as a correction unit. Then, the processing unit 12 emits the projection image 112 that has been deformed and corrected according to the image correction information 111 from the projection unit 13 as the projection light P1. In this way, the projection device 10 can project the projection image 2a (corrected projection image 112 (second projection image)) that has been corrected based on the information (for example, the image correction information 841 including the difference information (deformation degree) between the coordinates on the display element and the coordinates on the captured image 60) of the imaged projection image 2a (correction image 70 as the first projection image) through the projection light P1. Therefore, the projection device 10 can perform spatial projection so that the desired spatial projection image 4 a can be visually recognized by the viewer 50 .

[0048] As described above, the spatial projection device 100 of the present embodiment forms a projection object projected as a spatial projection image 4a by projecting the image 2a. Therefore, it is possible to display a projection image 2a with high brightness compared to the case of using a display image or a real object as a projection object, and the spatial projection image 4a can also be displayed vividly with high brightness. In addition, the projection image 2a projected by the projection device 10 can also be easily enlarged by increasing the shape of the imaging medium 20, 20A and appropriately vacating the distance between the projection device 10 and the imaging medium 20, 20A. Therefore, the spatial projection device 100 can project a larger spatial projection image 4a without greatly changing the overall structure. Furthermore, in the case of irradiating the projection light P1 obliquely with respect to the imaging medium 20 or forming the imaging medium 20 into an arbitrary three-dimensional surface shape, it is also possible to perform deformation correction on the projection image 2a on the imaging medium 20, and display the expected spatial projection image 4a from the viewer 50. In this way, by using the spatial projection method of the spatial projection device 100 (spatial projection system 1), spatial projection with high visual effect can be realized with a simple structure.

[0049] (Implementation Method 2)

[0050] Next, embodiment 2 will be described. Figure 6The following is a processing example in which the space projection device 100 in the space projection system 1 of the first embodiment calculates the image correction information 111 (deformation parameter) in the projection process of the projection image 112. In the space projection device 100 of the second embodiment, the description of the same configuration as that of the first embodiment is omitted or simplified.

[0051] In step S301, the processing unit 12 projects a correction image (not shown) capable of coordinate detection in an image projection of an arbitrary projection image 112, so as to be superimposed on the imaging medium 20. The correction image included in the projection image 112 may be, for example, a portion of the image included in the content information that can be easily deformed (position detected) by binarization processing.

[0052] In step S302, the processing unit 82 of the above-mentioned imaging device 80 uses the imaging device 81 to capture the projection image 112 including the correction image from the projection device 10 side to obtain the captured image 60. In addition, the processing unit 82 causes the projection device 10 to obtain the captured image 60 via the communication unit 85 and the communication unit 15. In step S303, the processing unit 12 in the projection device 10 compares the projection image 112 including the correction image with the captured image 60 obtained from the imaging device 80.

[0053] In step S304, the processing unit 12 determines whether the image deformation has changed (whether the image correction information 111 needs to be changed) by comparing the projection image 112 including the correction image with the captured image 60. For example, the processing unit 12 can determine that the image deformation has changed when the shape of the projection image 112 and the captured image 60 is deformed by more than a predetermined threshold. When the processing unit 12 determines that the image deformation has changed (S304, yes), it proceeds to the processing of step S305, and when it does not determine that the image deformation has changed (S304, no), it returns to the processing of step S302. As an example of the change in image deformation, for example, the case where the imaging medium 20 is replaced (switched) or the relative position of the imaging medium 20 and the projection device 10 is changed during the projection process of the projection image 112 can be cited.

[0054] In step S305, the processing unit 12 can detect the coordinates of the correction image in the captured image 60 and obtain the degree of deformation of the imaging medium 20. The processing unit 12 generates the image correction information 111 based on the information on the degree of deformation.

[0055] Furthermore, in step S306, the processing unit 12 can perform image correction processing on the projection image 112 (image data of content information) for viewing according to the image correction information 111. Then, the processing unit 12 emits the projection image 112 that has been deformed and corrected according to the image correction information 111 from the projection unit 13 as projection light P1. In this way, the projection device 10 can project the projection image 2a (corrected projection image 112 (second projection image)) that has been corrected according to information associated with the captured image 60 of the imaged projection image 2a (including the projection image 112 (first projection image) before correction of the correction image) (for example, image correction information 841 including differential information (degree of deformation) between the coordinates on the display element and the coordinates on the captured image 60) through the projection light P1. Therefore, the projection device 10 can perform spatial projection so that the expected spatial projection image 4a can be visually recognized by the viewer 50.

[0056] The spatial projection device 100 of Embodiment 2 can correct the projection image 2a based on the correction image included in the projection image 112 of the content information, etc. Therefore, the initial operation of calculating the image correction information 111 can be omitted, and spatial projection with high visual effects can be realized with a simple configuration.

[0057] As described above, the spatial projection device 100 of each embodiment 1 and embodiment 2 forms the projection image 2a projected as the spatial projection image 4a by the projection device 10. Therefore, compared with the case of using the display image or the real object as the projection object, the projection image 2a with high brightness can be displayed, and the spatial projection image 4a can also be displayed vividly with high brightness. In addition, the projection image 2a projected by the projection device 10 can also be easily made larger by making the shape of the imaging medium 20, 20A larger and appropriately vacating the distance between the projection device 10 and the imaging medium 20, 20A. Therefore, the spatial projection device 100 can project a larger spatial projection image 4a without significantly changing the overall structure. In this way, by using the spatial projection method of the spatial projection device 100 (spatial projection system 1), spatial projection with high visual effect can be realized with a simple structure.

[0058] In addition, the light guide optical system 30 described in the above Embodiments 1 and 2 may also adopt a structure different from the beam splitter 31 and the retroreflective member 32. For example, Figure 7 The space projection device 100A in the space projection system 1A shown in the figure is provided with a light guide optical system 30A including a light reflection member 33 instead of the light guide optical system 30 in the space projection device 100 in Embodiments 1 and 2. The light reflection member 33 is an optical member that re-images each point light source (for example, light from the imaging point F1) imaged on the imaging medium 20 in the space imaging unit 40 which is a plane-symmetrical position.

[0059] The light reflecting component 33 can adopt any structure. For example, as shown in the enlarged view of part C, a first mirror layer 331 including a plurality of first mirrors 331a and a second mirror layer 332 including a plurality of second mirrors 332a are adjacent to each other. The first mirror 331a is configured so that the mirror surface is parallel to the XY plane. In addition, the plurality of first mirrors 331a are arranged at equal intervals in the Z direction in a manner parallel to each other (also refer to the XII-XII cross-sectional view). The second mirror 332a is configured so that the mirror surface is orthogonal to the mirror surface of the first mirror 331a. In addition, the plurality of second mirrors 332a are arranged at equal intervals in a manner parallel to each other in a direction orthogonal to the arrangement direction of the first mirrors 331a. The light reflecting component 33 is configured so that the second mirrors 332a are arranged relative to the configuration surface S (in Figure 7 In the example shown in FIG. 1 , the YZ plane and the ZX plane are inclined at 45 degrees.

[0060] In addition, the enlarged view of part C shows the optical path of the case where the light L21 and L22 emitted from the imaging point F1 and parallel to the XY plane are incident on the light reflecting component 33. The light L21 and the light L22 are not irradiated on the mirror surface of the first mirror 331a arranged parallel to the XY plane, but are incident on the mirror surface of the second mirror 332a. The light L21 and the light L22 are respectively reflected at the same reflection angle as the incident angle when they are incident on the second mirror 332a. The light L21 is incident on the second mirror 332a (light reflecting component 33) at a larger incident angle than the light L22, so the light L21 is reflected at a larger reflection angle than the light L22. Therefore, the light L2 emitted from the imaging point F1 with a predetermined diffusion angle is reflected from the light reflecting component 33 as the light L3 with the same focusing angle as the diffusion angle of the light L2, and is imaged again at the imaging point F2 which is in a plane-symmetrical position relative to the light reflecting component 33. In addition, the diffusion component in the Z direction of the light L2 emitted from the imaging point F1 is also reflected by the first mirror 331 a and is imaged again at the imaging point F2 .

[0061] In addition, the structure of the light reflecting member 33 is not limited to the structure shown in the enlarged view of part C, and other light reflecting members that re-image each point light source imaged on the imaging medium 20 in the space imaging unit 40 as a plane-symmetrical position may be used. For example, the light reflecting member may be configured to provide a plurality of fine prisms to reflect light incident at a predetermined diffusion angle as light focused at a focusing angle substantially the same as the diffusion angle, and emit light incident from the point light source in a manner of imaging at a plane-symmetrical position.

[0062] Above, in Figure 7 In the space projection device 100A and the space projection system 1A, compared with the embodiment 1, Figure 1 and Figure 3The light guide optical system 30 shown can reduce the number of parts and simplify the structure, so the entire system can be miniaturized. Therefore, it is possible to realize spatial projection with high visual effects with a simple structure.

[0063] In addition, the spatial projection apparatus 100, 100A described in each embodiment may be configured by configuring the projection apparatus 10, the shooting apparatus 80, the imaging medium 20, the light guide optical system 30, 30A, and the spatial imaging unit 40 in one device, or may be configured in a plurality of devices. For example, the spatial projection apparatus 100, 100A may be configured by including the imaging medium 20 (20A to 20E), the light guide optical system 30, 30A, and a part of the functions of the spatial imaging unit 40 in the projection apparatus 10.

[0064] In addition, in the present embodiment, an example of setting the projection device 10 is described as a projection control device that includes an acquisition unit that acquires information associated with a first projection image projected by the projection device 10 and imaged on the imaging medium 20, and a correction unit that corrects information of a second projection image that is imaged on the imaging medium 20 as projection light re-imaged in the spatial imaging unit 340 using the light guiding optical system 30 based on the acquired information associated with the first projection image, but a device different from the projection device 10 may also be set. Figure 8 FIG. 1 is a schematic plan view showing another configuration example of the space projection device 100. Figure 1 The spatial projection device 100 further includes a projection control device 90 in addition to the structure of the spatial projection device 100. The projection control device 90 includes the correction unit, a communication unit (acquisition unit) for acquiring information such as the captured image 60, and a storage unit for storing data related to the projection image ( Figure 2 The projection control device 90 may be a general-purpose device such as a personal computer or a dedicated device. The projection control device 90 obtains the captured image 60 and the image correction information 841 from the imaging device 80 via the communication unit, and the correction unit corrects the projection image 112, and sends the corrected projection image 112 to the projection device 10. Therefore, the projection control device 90 can control so that the corrected projection image 112 (second projection image) is projected from the projection device 10. In addition, the projection control device 90 may also be set at Figure 7 The spatial projection device 100A is shown.

[0065] In addition, the camera 80 may also shoot the projection image 2a formed on the imaging medium 20, 20A from one of the first surface 21 or the second surface 22, and may also shoot the projection image (spatial projection image 4a) formed on the spatial imaging unit 40 from the emission side (viewer 50 side). The camera 80 is not limited to being provided separately from the projection device 10 in the spatial projection device 100, 100A, but may be provided as a part of the projection device 10, or may be provided as a structure not included in the spatial projection device 100, 100A. The communication between the projection device 10 and the camera 80 may be performed by any method, whether wired or wireless.

[0066] In addition, the spatial projection device 100 can also be combined Figure 4 The processing and Figure 6 The processing shown is performed.

[0067] also, Figure 4 and Figure 6 The processing after the imaging (S204 to S206 and S303 to S306) may be performed by one of the projection device 10 and the imaging device 80, or may be performed by another device different from the projection device 10 and the imaging device 80.

[0068] In addition, the method of acquiring information associated with the first projection image projected by the projection device 10 and formed on the imaging medium 20 may be a method other than photographing.

[0069] In addition, the projection device 10 is not limited to the above-mentioned DLP method, and may be other methods. As the projection device 10, an LCP (liquid crystal panel) method projection device may also be used. The LCP method projection device controls the transmittance of blue band light, green band light, and red band light for each pixel through a liquid crystal filter (liquid crystal panel), synthesizes the blue band light, green band light, and red band light of each pixel that has passed through the liquid crystal filter, and emits it as projection light.

[0070] In addition, as the projection device 10, a projection device of LCoS (Liquid Crystal on Silicon) method can also be used. In the projection device of LCoS method, a display element having a liquid crystal filter (liquid crystal layer) capable of making the transmittance of light variable (including light shielding) corresponding to each pixel is arranged on the reflective layer instead of the DMD in the projection device 10 of DLP method. Therefore, the projection device can reflect the light source light irradiated into the display element while controlling the light amount for each pixel to form image light, and emit the image light to the outside as projection light to project the projection image 2a onto the imaging medium 20, 20A.

[0071] In the example where the above-mentioned LCP method or LCoS method projection device is used as the projection device 10, each light (blue band light, green band light, and red band light) transmitted through the liquid crystal filter is polarized light having a predetermined polarization direction. Therefore, for example, in Embodiment 1, a polarizer that reflects one of the S polarized light and the P polarized light and transmits the other may be arranged as the beam splitter 31, and a quarter wave plate may be arranged on the optical path between the beam splitter 31 and the retroreflective component 32. Thus, the beam splitter 31 reflects one of the S polarized light and the P polarized light, that is, the light of the first polarization direction, out of the light emitted from the imaging medium 20, 20A, toward the retroreflective component 32 side, and after being transmitted through the quarter wave plate and converted into circularly polarized light, it is reflected by the retroreflective component 32. The circularly polarized light reflected by the retroreflective component 32 is transmitted through the quarter wave plate again and converted into light of the second polarization direction orthogonal to the first polarization direction, and is transmitted through the beam splitter 31. In this way, when a polarizer is used as the beam splitter 31, most of the light once reflected by the beam splitter can be reflected by the retroreflective member 32 and then transmitted through the beam splitter 31, so that the light utilization efficiency can be improved compared to the case of using a half mirror.

[0072] In addition, as the projection device 10, a laser scanning projection device can also be used. In the laser scanning projection device, the laser light synthesized by the blue band light, the green band light and the red band light colors into the desired color is irradiated to the display element, and the display element controls the reflection angle of the laser light in time division and reflects it to irradiate the imaging medium 20, 20A as the projected body. At this time, the display element can irradiate the laser light to the imaging medium 20, 20A in a two-dimensional scanning manner in the vertical direction and the horizontal direction, and project the projection image 2a to the imaging medium 20, 20A. In the laser scanning projection device, the projection lens that focuses the light emitted from the display element can be omitted, so the projection device can be miniaturized as a whole. In addition, the projection device can form an image by laser, so when using a stereoscopic imaging medium with large concave and convex surfaces, the expected clear projection image 2a can also be projected.

[0073] Furthermore, although the imaging medium 20, 20A is exemplified by a plate-like or film-like structure, a fluid such as smoke or water may also be used. When a fluid is used for the imaging medium 20, 20A, a light-transmitting container may be provided to seal the fluid.

[0074] In addition, the imaging medium 20 can be colored. Thus, the color of the spatial projection image 4a can be changed or the color tone can be adjusted arbitrarily. In the case of using a fluid as the imaging medium 20, 20A, the fluid can also be colored. The coloring of the imaging medium 20, 20A can be changed over time in a time series. Thus, various expression effects can be presented.

[0075] Furthermore, the light guide optical system 30 , 30A may be configured to re-image the light emitted from the imaging medium 20 , 20A in the spatial imaging unit 40 using a Fresnel lens.

[0076] In addition, in each embodiment, a transmissive imaging medium is used as an example in which the projection light P1 projected onto the imaging medium 20, 20A is incident from the first surface 21 side of the imaging medium 20, 20A, is emitted from the second surface 22 side opposite to the first surface 21, and guides the light as the spatial projection light P2 to the light guide optical system 30, 30A, but a reflective imaging medium (a projector screen, a wall, or other projection medium) may be used in which the surface from which the projection light P1 is emitted is the same surface as the surface from which the spatial projection light P2 is emitted.

[0077] In addition, the projection image 2a formed on the imaging medium 20, 20A by the projection light P1 is not limited to the image formed by the projection light emitted from the projection device 10, and can also be set to be a light image formed by any light source light, illumination light, LED light or laser emitted as projection light from other light source devices. In addition, the projection image 2a can be formed by visible light or non-visible light (for example, for digital watermarking, etc.) by using any light source.

[0078] As described above, the spatial projection system 1, 1A and the spatial projection device 100, 100A described in each embodiment include the projection device 10 and the imaging medium 20, 20A imaged by the projection light re-imaged in the spatial imaging unit 40 by the light guide optical system 30, 30A. In addition, the projection device 10 projects the second projection image (the corrected projection image 112 projected as the projection image 2a and the spatial projection image 4a) corrected based on the information related to the captured image 60 of the imaged first projection image (the projection image 112 including the correction image 70 of the embodiment 1 or the correction image of the embodiment 2 projected as the projection image 2a and the spatial projection image 4a) through the projection light P1. Furthermore, a projection control device for controlling the projection processing of the spatial projection system 1, 1A and the spatial projection device 100, 100A comprises: an acquisition unit for acquiring information related to a first projection image (2a) projected by the projection device 10 and imaged on the imaging medium 20; and a correction unit for correcting information related to the first projection image (2a) imaged on the imaging medium 20 as projection light re-imaged in the spatial imaging unit 40 by the light guide optical system 30, based on the acquired information related to the first projection image (2a). Thus, even when the projection light P1 is irradiated obliquely with respect to the imaging medium 20, 20A, or when the imaging medium 20, 20A is formed into an arbitrary three-dimensional surface, the projection image 2a on the imaging medium 20, 20A can be deformed and corrected, and the expected spatial projection image 4a can be displayed from the viewer 50. Therefore, spatial projection with high visual effect can be realized without any defect in the image.

[0079] Furthermore, the acquisition unit acquires the captured image 60 of the first projection image (2a) formed on the imaging medium 20 as information related to the first projection image (2a), so that the projection control device can easily acquire relevant information for the first projection image (2a).

[0080] Furthermore, the spatial projection apparatus 100 or 100A that acquires the captured image 60 by capturing the imaging medium 20 from the projection apparatus 10 can reduce exposure of the imaging apparatus 80 to the viewer 50 and can detect deformation of the projection image 2 a on the projection apparatus 10 side.

[0081] In addition, the spatial projection device 100, 100A, which projects the correction image 70 for calculating the degree of deformation of the imaging medium 20, 20A before projecting the projection image 112 as an ornamental image to obtain the captured image 60, can project the spatial projection image 4a in the expected shape, etc. even if the shape of the imaging medium 20, 20A or the positional relationship between the projection device 10 and the imaging medium 20, 20A is changed.

[0082] In addition, the spatial projection device 100, 100A obtains the captured image 60 in the projection of the projection image 112 as an ornamental image including a correction image capable of position detection, and can project the spatial projection image 4a in the expected shape, etc. even if the shape of the imaging medium 20, 20A or the positional relationship between the projection device 10 and the imaging medium 20, 20A is changed in the projection of the projection image 112.

[0083] Furthermore, the spatial projection apparatus 100, 100A that performs deformation correction as correction of the projected image 112 corrects the deformation caused by the projection direction of the projection light P1 or the shape of the imaging medium 20, 20A as the projection surface, and can project a spatial projection image with high visual effect.

[0084] Furthermore, the space projection device 100 or 100A including the light guiding optical system 30 or 30A which guides the light formed on the imaging medium 20 or 20A and re-images it in the space imaging unit 40 can reduce the overall structure.

[0085] The imaging medium 20, 20A is a transmissive member that is irradiated with the projection light P1 on the first surface 21 side and diffuses the light toward the light guide optical system 30, 30A from the second surface 22 side, which is the opposite side of the first surface 21. Thus, the structure including the imaging medium 20, 20A and the light guide optical system 30, 30A can be miniaturized.

[0086] In addition, the light guide optical system 30, 30A has a beam splitter 31 and a retroreflective component 32, and the beam splitter 31 reflects the light emitted from the imaging medium 20, 20A toward the retroreflective component 32, and transmits the light reflected by the retroreflective component 32 toward the spatial imaging unit 40. In this way, wide-angle light emitted from each point light source on the projected image 2a can be easily formed.

[0087] In addition, the following spatial projection method is described, that is, information related to the first projection image (projection image 112 including the correction image 70 of the first embodiment or the correction image of the second embodiment projected as the projection image 2a and the spatial projection image 4a) projected by the projection device 10 and formed on the imaging medium 20, 20A is obtained, and based on the information related to the first projection image obtained, information of the second projection image (corrected projection image 112 projected as the projection image 2a and the spatial projection image 4a) formed on the imaging medium 20, 20A as the projection light re-imaged in the spatial imaging unit 40 by the light guide optical system 30 is corrected, and the second projection image is projected by the projection device 10. Thus, even when the projection light P1 is irradiated obliquely with respect to the imaging medium 20, 20A, or when the imaging medium 20, 20A is formed into an arbitrary three-dimensional surface shape, the projection image 2a on the imaging medium 20, 20A can be deformed and corrected, and the expected spatial projection image 4a can be displayed from the viewer 50. Therefore, it is possible to realize space projection with high visual effects without any defects in the image.

[0088] In addition, the embodiments described above are provided as examples and are not intended to limit the scope of the invention. These new embodiments can be implemented in various other forms, and various omissions, substitutions, and changes can be made without departing from the scope of the invention. These embodiments and their variations are included in the scope and spirit of the invention, and are included in the invention described in the claims and their equivalents.

Claims

1. A projection control device, characterized in that: have: an acquisition unit that acquires a captured image of the first projection image as information related to the first projection image projected by the projection device and imaged on the imaging medium; and a correction unit that corrects information of a second projection image formed on the imaging medium as projection light re-imaged by the light guide optical system in a spatial imaging unit for visually recognizing an imaging position of an image for viewing, based on the acquired information related to the first projection image; The projection light projected from the projection device onto the imaging medium is incident on the imaging medium without passing through the spatial imaging unit.

2. The projection control device according to claim 1, characterized in that: The imaging medium is photographed from the projection device side to obtain the photographed image.

3. The projection control device according to claim 2, characterized in that: Before projection of the projection image as the viewing image, a correction image for obtaining the degree of deformation of the imaging medium is projected to obtain the captured image.

4. The projection control device according to claim 2, characterized in that: The captured image is acquired during projection of a projection image as a viewing image including a correction image capable of position detection.

5. The projection control device according to any one of claims 1 to 4, characterized in that: The above correction is a deformation correction.

6. The projection control device according to any one of claims 1 to 4, characterized in that: Having the above-mentioned light-guiding optical system, The light guiding optical system guides the light formed on the imaging medium and re-images the light in the space imaging unit.

7. The projection control device according to any one of claims 1 to 4, characterized in that: Having the above imaging medium, The imaging medium is irradiated with the projection light on the first surface side and is formed from the opposite side of the first surface. The second surface is a transmissive member that diffuses and emits light toward the light-guiding optical system.

8. The projection control device according to any one of claims 1 to 4, characterized in that: The above-mentioned light guiding optical system has a beam splitter and a retroreflective component. The beam splitter reflects the light emitted from the imaging medium toward the retroreflective member, and transmits the light reflected by the retroreflective member toward the spatial imaging unit.

9. A spatial projection device, characterized in that: have: Projection device; an acquisition unit that acquires a captured image of the first projection image as information related to the first projection image projected by the projection device and imaged on an imaging medium; as well as a correction unit that corrects information of a second projection image formed on the imaging medium as projection light re-imaged by the light guide optical system in a spatial imaging unit for visually recognizing an imaging position of an image for viewing, based on the acquired information related to the first projection image; The projection light projected from the projection device onto the imaging medium is incident on the imaging medium without passing through the spatial imaging unit.

10. A spatial projection system, characterized in that: A space projection device as claimed in claim 9 is provided.

11. A spatial projection method, characterized in that: acquiring a captured image of the first projection image as information related to the first projection image projected by the projection device and imaged on the imaging medium; Based on the acquired information related to the first projection image, the information of the second projection image formed on the imaging medium as the projection light re-imaged in the spatial imaging unit by the light guide optical system is corrected, and the second projection image is projected through the projection device, wherein the spatial imaging unit is an imaging position for visually recognizing the viewing image. The projection light projected from the projection device onto the imaging medium is incident on the imaging medium without passing through the spatial imaging unit.

Citation Information

Patent Citations

  • Airborne video projector

    JP2006317708A

  • System and method for holographical projection real-time three-dimension display

    CN101855600A

  • Projector device, image projecting method, program for this method, recording medium with the program recorded thereon

    JP2004177841A

  • Image input / output device

    JP2005293290A

  • Space projection device, space projection method, and space projection program

    JP2015100084A