Floating-in-the-air image display

Abstract

To provide a more suitable air floating video display device. The present invention contributes to "health and well-being for all three people", "9 Build a foundation for industry and technical innovation", and "11 Keep living", which are sustainable development goals (SDGs).SOLUTION: A floating-in-the-air image display device that displays a floating-in-the-air image includes an image processing unit, a display device, an optical system, and a housing, in which a light-transmissive member having an image light emission unit that emits image light forming the floating-in-the-air image to the outside in the housing includes a design layer that is a layer for displaying a graphic design of a user interface related to the floating-in-the-air image and has a transmissive portion and a non-transmissive portion, and a light source that supplies light for forming the graphic design by emitting the light to the outside through the transmissive portion of the design layer.SELECTED DRAWING: Figure 15

Description

[Technical Field]

[0001] The present invention relates to a floating-in-the-air image display device. [Background technology]

[0002] The floating information display technology is disclosed in, for example, Patent Document 1. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-128722 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the disclosure of Patent Document 1 does not sufficiently consider a configuration for obtaining practical brightness and quality for the floating image, or a configuration for allowing the user to view the floating image more enjoyably.

[0005] An object of the present invention is to provide a more suitable floating-in-the-air image display device. [Means for solving the problem]

[0006] To solve the above problems, for example, the configuration described in the claims is adopted. The present application includes multiple means for solving the above problems, and one example thereof may be configured as follows: A floating-in-the-air image display device that displays a floating-in-the-air image includes: an image processing unit that processes the image; a display device that emits image light based on the image processed by the image processing unit; an optical system that forms the floating-in-the-air image based on the image light emitted by the display device; and a housing that holds the display device and the optical system, wherein a light-transmitting member in the housing has an image light emission unit through which the image light that forms the floating-in-the-air image is emitted to the outside, the light source includes: a design layer that has a transparent portion and a non-transparent portion and is used to display a graphic design of a user interface related to the floating-in-the-air image; and a light source that supplies light that is emitted to the outside through the transparent portion of the design layer to form the graphic design. [Effects of the Invention]

[0007] According to the present invention, a more suitable floating-in-the-air image display device can be realized. Other problems, configurations, and effects will become clear in the following description of the embodiments. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing an example of a usage form of a space floating image display device according to an embodiment of the present invention; [Figure 2A] 1 is a diagram showing an example of a main part configuration and a retroreflection part configuration of a space floating image display device according to an embodiment of the present invention; [Figure 2B] 1 is a diagram showing an example of a main part configuration and a retroreflection part configuration of a space floating image display device according to an embodiment of the present invention; [Figure 2C] 1 is a diagram showing an example of a main part configuration and a retroreflection part configuration of a space floating image display device according to an embodiment of the present invention; [Figure 2D] 1 is a diagram showing an example of a main part configuration and a retroreflection part configuration of a floating-in-the-air image display device according to an embodiment of the present invention; [Figure 2E]1 is a projection view of a retroreflector constituting a floating-in-the-air image display device according to an embodiment of the present invention; [Figure 2F] 1 is a top view of a retroreflector constituting a floating-in-the-air image display device according to an embodiment of the present invention; FIG. [Figure 2G] FIG. 1 is a perspective view showing a corner reflector that constitutes a retroreflector that constitutes a floating-in-the-air image display device according to an embodiment of the present invention. [Figure 2H] FIG. 1 is a top view showing a corner reflector that constitutes a retroreflector that constitutes a floating-in-the-air image display device according to an embodiment of the present invention. [Figure 2I] FIG. 1 is a side view showing a corner reflector that constitutes a retroreflector that constitutes a floating-in-the-air image display device according to an embodiment of the present invention. [Figure 3] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4A] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4B] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4C] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4D] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4E] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4F] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4G] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4H] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4I] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4J]1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4K] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4L] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4M] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4N] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4O] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 4P] 1 is a diagram showing an example of the configuration of a space floating image display device according to an embodiment of the present invention; [Figure 5] 1 is a cross-sectional view showing an example of a specific configuration of a light source device according to an embodiment of the present invention. [Figure 6] 1 is a cross-sectional view showing an example of a specific configuration of a light source device according to an embodiment of the present invention. [Figure 7] 1 is a cross-sectional view showing an example of a specific configuration of a light source device according to an embodiment of the present invention. [Figure 8] 1 is a layout diagram showing a main part of a space floating image display device according to an embodiment of the present invention; [Figure 9] 1 is a cross-sectional view showing a configuration of a display device according to an embodiment of the present invention. [Figure 10] 1 is a cross-sectional view showing a configuration of a display device according to an embodiment of the present invention. [Figure 11] 1 is an explanatory diagram for explaining the light source diffusion characteristics of an image display device according to an embodiment of the present invention. [Figure 12] 1 is an explanatory diagram for explaining the diffusion characteristics of a video display device according to an embodiment of the present invention; [Figure 13] FIG. 10 is a diagram showing a configuration example of a space floating image display device according to a comparative example. [Figure 14] 1 is a diagram illustrating a configuration example of a space floating image display device according to an embodiment; [Figure 15] 1 is a diagram showing a configuration example of a top surface of a housing in a space floating image display device according to an embodiment of the present invention; [Figure 16] 1 is a diagram showing an example of a cross-sectional configuration of an upper surface of a housing in a space floating image display device according to an embodiment; [Figure 17] 10A and 10B are diagrams illustrating an example of the cross-sectional configuration of a design layer in a space floating image display device according to an embodiment. [Figure 18] 10A and 10B are diagrams illustrating an example of the configuration of a light guide of a design layer in a space floating image display device according to an embodiment. [Figure 19] FIG. 10 is a diagram showing a configuration example of the arrangement of mid-air operation detection sensors relative to a design layer in a space floating image display device according to one embodiment. [Figure 20] 1A and 1B are diagrams illustrating an example of the configuration of a decorative layer in a space floating image display device according to an embodiment. [Figure 21] 10A and 10B are diagrams illustrating an example of a cross-sectional configuration of a design layer of a modified example in the space floating image display device according to an embodiment. [Figure 22] 10A and 10B are diagrams illustrating another example of the cross section of the design layer in the space floating image display device according to the embodiment. [Figure 23A] 10 is a diagram showing a cross section of a modified transmissive / non-transmissive layer in the space floating image display device according to one embodiment. FIG. [Figure 23B] 10 is a diagram showing a cross section of a modified transmissive / non-transmissive layer in the space floating image display device according to one embodiment. FIG. [Figure 24] 1 is a diagram showing a plan view of an example of a graphic design display in a space floating image display device according to an embodiment. FIG. [Figure 25A] FIG. 10 is a diagram showing a cross section of an example of a sensor mechanism for displaying a graphic design in a space floating image display device according to one embodiment. [Figure 25B] FIG. 10 is a diagram showing a cross section of another example of a sensor mechanism for displaying graphic designs in a space floating image display device according to an embodiment. [Figure 26] 10A and 10B are diagrams showing cross sections of a modified diffuse reflection member in the space floating image display device according to one embodiment. [Figure 27] 10 is a cross-sectional view of a modified example of a display device for displaying graphic designs in a space floating image display device according to an embodiment. FIG. [Figure 28] 10 is a cross-sectional view of a modified light source device for displaying graphic designs in the space floating image display device according to an embodiment. FIG. [Figure 29] FIG. 10 is a diagram showing a table summarizing control examples in the space floating image display device according to one embodiment. [Figure 30] FIG. 1 is a diagram illustrating an example of a configuration for control in a space floating image display device according to an embodiment. [Figure 31] 10 is a diagram showing a configuration example of a top surface of a housing in a plan view, relating to local dimming control using a side light source, in a space floating image display device according to an embodiment. FIG. [Figure 32A] 10A and 10B are diagrams illustrating an example of a display state on the top surface in relation to local dimming control using a side light source in a space floating image display device according to an embodiment. [Figure 32B] 10A and 10B are diagrams illustrating an example of a display state on the top surface in relation to local dimming control using a side light source in a space floating image display device according to an embodiment. [Figure 32C] 10A and 10B are diagrams illustrating an example of a display state on the top surface in relation to local dimming control using a side light source in a space floating image display device according to an embodiment. [Figure 33] 10 is a diagram showing a configuration example of a top surface of a housing in a plan view, relating to local dimming control using a side light source, in a space floating image display device according to an embodiment. FIG. [Figure 34] FIG. 10 is a diagram showing an example of the configuration of a planar view of a graphic design displayed on the top surface in relation to local dimming control using a side light source in a space floating image display device according to an embodiment. [Figure 35] 10 is a diagram illustrating an enlarged view of a portion of a graphic design displayed on the top surface of a space floating image display device according to an embodiment. FIG. [Figure 36]10 is a diagram showing an enlarged view of a portion of a modified graphic design display in the space floating image display device according to an embodiment. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the description of the embodiments, and various changes and modifications can be made by those skilled in the art within the scope of the technical ideas disclosed in this specification. Furthermore, in all drawings used to explain the present invention, components having the same functions are given the same reference numerals, and repeated explanations thereof may be omitted.

[0010] The following examples relate to an image display device that can transmit an image generated by image light from an image light source through a transparent member that separates a space, such as glass, and display the image as a floating image outside the transparent member. In the following explanation of the examples, the image floating in space is expressed using the term "floating image in space." Instead of this term, it is also acceptable to express it as "aerial image," "spatial image," "floating image in space," "floating optical image of displayed image," "floating optical image of displayed image," etc. The term "floating image in space," which is mainly used in the explanation of the examples, is used as a representative example of these terms.

[0011] According to the following embodiments, an image display device suitable for, for example, bank ATMs, train station ticket machines, digital signage, and the like can be realized. For example, currently, bank ATMs, train station ticket machines, and the like typically use touch panels. However, by using a transparent glass surface or a light-transmitting plate, high-resolution image information can be displayed in a floating state on the glass surface or light-transmitting plate. In this case, by making the divergence angle of the emitted image light small, i.e., an acute angle, and further aligning it with a specific polarization, only the normal reflected light is efficiently reflected by the retroreflector. This improves light utilization efficiency and suppresses the ghost images that occur in addition to the main floating image, which is a problem with conventional retroreflection systems, thereby achieving a clear floating image. Furthermore, by using a device including the light source of this embodiment, a novel and highly usable floating image display device (floating image display system) can be provided that can significantly reduce power consumption. Furthermore, a floating image display device for a vehicle can be provided that can display a so-called unidirectional floating image that can be viewed inside and / or outside the vehicle.

[0012] Example 1 An example of the configuration of a space floating image display device will be described below as a first embodiment of the present invention.

[0013] <Example of how to use the space floating image display device> FIG. 1 is a diagram showing an example of a usage form of a space-floating image display device according to an embodiment of the present invention, and is a diagram showing the overall configuration of the space-floating image display device according to this embodiment. The specific configuration of the space-floating image display device will be described in detail using FIG. 2 and other figures. Light with a narrow-angle directional characteristic and specific polarization is emitted from image display device 1 as an image light beam, reflected by the optical system within the space-floating image display device, and then incident on retroreflector 2. It is then retroreflected and transmitted through transparent member 100 (glass, etc.), forming a real aerial image (space-floating image 3) on the outside of the glass surface. In the following embodiments, the retroreflector 2 (retroreflector) is used as an example of a retroreflector. However, the retroreflector 2 of the present invention is not limited to a planar plate, and is used as an example of a concept including a sheet-like retroreflector attached to a planar or non-planar member, or an entire assembly in which a sheet-like retroreflector is attached to a planar or non-planar member. Furthermore, since the light rays reflected by the retroreflector 2 have the optical property of forming an image, the retroreflector 2 may also be expressed as an imaging optical member or an imaging optical plate.

[0014] In addition, in a store or the like, a space is partitioned by a show window (also called "window glass") 105, which is a translucent member such as glass. According to the space floating image display device of this embodiment, it is possible to transmit such a transparent member and display a floating image in one direction to the outside and / or inside of the store (space).

[0015] 1, the inside of the window glass 105 (inside the store) is shown in the depth direction, and the outside (for example, the sidewalk) is shown in the foreground. On the other hand, by providing a means for reflecting specific polarized waves on the window glass 105, it is possible to reflect the waves and form an aerial image at a desired position inside the store.

[0016] <Configuration example of optical system for space floating image display device> 2A is a diagram showing an example of the configuration of an optical system of a space-floating image display device according to one embodiment of the present invention. The configuration of the space-floating image display device will be described in more detail using FIG. 2A. As shown in FIG. 2A(1), a display device 1 that diverges specific polarized image light at a narrow angle is provided in an oblique direction of a transparent member 100 such as glass. The display device 1 includes a liquid crystal display panel 11 and a light source device 13 that generates specific polarized light with narrow-angle diffusion characteristics.

[0017] Image light of a specific polarization from the display device 1 is reflected by a polarization separator 101 (in the figure, the polarization separator 101 is formed into a sheet and adhered to the transparent member 100) that has a film that selectively reflects image light of a specific polarization and is provided on a transparent member 100, and then enters the retroreflector 2. A λ / 4 plate 21 is provided on the image light incident surface of the retroreflector 2. The image light passes through the λ / 4 plate 21 twice, once when it enters the retroreflector 2 and once when it exits, thereby undergoing polarization conversion from the specific polarization to the other polarization. Here, the polarization separator 101 that selectively reflects image light of a specific polarization has the property of transmitting the polarized light of the other polarization that has been polarization-converted, so the image light of the specific polarization after polarization conversion passes through the polarization separator 101. The image light that has passed through the polarization separator 101 forms a space-floating image 3, which is a real image, outside the transparent member 100. 2A shows an example in which the chief ray of the image light incident on the retroreflector 2 is incident at an angle of 90° to the retroreflector 2. However, the incident angle of the chief ray of the image light on the retroreflector 2 is not limited to 90°, and an angle of, for example, 90°±15° can also be used.

[0018] Here, a first example of polarization design for the optical system of FIG. 2A will be described. For example, S-polarized (S stands for Senkrecht; polarized light whose electric field oscillates perpendicular to the plane of incidence) image light may be emitted from display device 1 to polarization separator 101, which may have the property of reflecting S-polarized light and transmitting P-polarized (P stands for parallel; polarized light whose electric field oscillates within the plane of incidence) light. In this case, the S-polarized image light reaching polarization separator 101 from display device 1 is reflected by polarization separator 101 and travels toward retroreflector 2. When the image light is reflected by retroreflector 2, it passes twice through λ / 4 plate 21 provided on the incident surface of retroreflector 2, and is therefore converted from S-polarized to P-polarized light. The P-polarized image light then travels toward polarization separator 101 again. Here, the polarization separation member 101 has the property of reflecting S-polarized light and transmitting P-polarized light, so the P-polarized image light passes through the polarization separation member 101 and then through the transparent member 100. The image light that passes through the transparent member 100 is light generated by the retroreflector 2, and therefore forms a space-floating image 3, which is an optical image of the image displayed on the display device 1, at a position that is in a mirror relationship with the image displayed on the display device 1 relative to the polarization separation member 101. This polarization design allows the space-floating image 3 to be formed optimally.

[0019] Next, a second example of polarization design for the optical system of FIG. 2A will be described. For example, P-polarized image light may be emitted from display device 1 to polarization separator 101, which may have the property of reflecting P-polarized light and transmitting S-polarized light. In this case, the P-polarized image light reaching polarization separator 101 from display device 1 is reflected by polarization separator 101 and travels toward retroreflector 2. When the image light is reflected by retroreflector 2, it passes twice through λ / 4 plate 21 provided on the incident surface of retroreflector 2, converting the P-polarized light to S-polarized light. The S-polarized image light then travels back toward polarization separator 101. Here, polarization separator 101 has the property of reflecting P-polarized light and transmitting S-polarized light, so the S-polarized image light passes through polarization separator 101 and then through transparent member 100. The image light transmitted through the transparent member 100 is light generated by the retroreflector 2, and therefore forms a floating image 3, which is an optical image of the image displayed on the display device 1, at a position that is in a mirror relationship with the image displayed on the display device 1 relative to the polarization separation member 101. This polarization design allows the floating image 3 to be formed optimally.

[0020] The light that forms the floating image 3 is a collection of light rays that converge from the retroreflector 2 to the optical image of the floating image 3, and these light rays continue to travel in a straight line even after passing through the optical image of the floating image 3. Therefore, the floating image 3 is a highly directional image, unlike the diffused image light formed on a screen by a general projector or the like. Therefore, in the configuration of FIG. 2A, when a user views the floating image 3 from the direction of arrow A, the floating image 3 is perceived as a bright image. However, when another person views the floating image 3 from the direction of arrow B, the floating image 3 cannot be perceived as an image at all. This characteristic is very suitable for use in a system that displays images that require high security or highly confidential images that should be kept secret from people directly facing the user.

[0021] Depending on the performance of the retroreflector 2, the polarization axis of the reflected image light may become irregular. The reflection angle may also become irregular. Such irregular light may not maintain the polarization state and propagation angle assumed in the design. For example, light with an unintended polarization state and propagation angle may re-enter the image display surface of the liquid crystal display panel 11 directly from the position of the retroreflector 2 without passing through a polarization separation member. Such light with an unintended polarization state and propagation angle may re-enter the image display surface of the liquid crystal display panel 11 after being reflected by components within the space-floating image display device. Such light re-entering the image display surface of the liquid crystal display panel 11 may be re-reflected by the image display surface of the liquid crystal display panel 11 constituting the display device 1, potentially generating ghost images and degrading the image quality of the space-floating image. Therefore, in this embodiment, an absorbing polarizer 12 may be provided on the image display surface of the display device 1. The image light emitted from the display device 1 is transmitted through the absorptive polarizer 12, and the reflected light returning from the polarization separation member 101 is absorbed by the absorptive polarizer 12, thereby suppressing the re-reflection. This makes it possible to prevent degradation of image quality due to ghost images of spatially floating images. Specifically, if the display device 1 is configured to emit S-polarized image light to the polarization separation member 101, the absorptive polarizer 12 may be a polarizer that absorbs P-polarized light. Furthermore, if the display device 1 is configured to emit P-polarized image light to the polarization separation member 101, the absorptive polarizer 12 may be a polarizer that absorbs S-polarized light.

[0022] The polarization separation member 101 may be formed of, for example, a reflective polarizing plate or a metal multilayer film that reflects specific polarized waves.

[0023] Next, Fig. 2A(2) shows an example of the surface shape of a typical retroreflector 2. A prism body with a regularly arranged array of triangular pyramidal recessed reflective surfaces is arranged on the retroreflector 2. Light rays incident on the arranged triangular pyramidal recesses are reflected by the multiple reflective surfaces of the triangular pyramidal recesses and emitted as retroreflected light in a direction corresponding to the incident light, and a real floating image is displayed based on the image displayed on the display device 1.

[0024] The surface shape of the retroreflector according to this embodiment is not limited to the above example. Various surface shapes that achieve retroreflection may be used. Specifically, the surface of the retroreflector according to this embodiment may be provided with retroreflection elements in which triangular pyramidal prisms, hexagonal pyramidal prisms, other polygonal prisms, multi-vertex prisms, or a combination of these are periodically arranged. Alternatively, the surface of the retroreflector according to this embodiment may be provided with retroreflection elements in which these prisms are periodically arranged to form cube corners. These may also be referred to as corner reflector arrays or polyhedral reflector arrays. Alternatively, the surface of the retroreflector according to this embodiment may be provided with capsule lens-type retroreflection elements in which glass beads are periodically arranged. The detailed configuration of these retroreflection elements can be achieved using existing technology, so a detailed description will be omitted. Specifically, the techniques disclosed in Japanese Patent Laid-Open Nos. 2001-33609, 2001-264525, 2005-181555, 2008-70898, and 2009-229942 may be used.

[0025] <Another configuration example 1 of the optical system of the space floating image display device> Another example of the configuration of the optical system of the space floating image display device will be explained using Fig. 2B. In Fig. 2B, components with the same reference numerals as Fig. 2A have the same functions and configurations as Fig. 2A. For the sake of simplicity, repeated explanations of such components will be omitted.

[0026] In the optical system of FIG. 2B, as in FIG. 2A, image light of a specific polarization is output from the display device 1. The image light of a specific polarization output from the display device 1 is input to a polarization separator 101B. The polarization separator 101B is a member that selectively transmits image light of a specific polarization. Unlike the polarization separator 101 of FIG. 2A, the polarization separator 101B is not integrated with the transparent member 100 but has an independent plate-like shape. Therefore, the polarization separator 101B may also be referred to as a polarization separator plate. The polarization separator 101B may be configured as a reflective polarizer configured by attaching a polarization separator sheet to a transparent member. Alternatively, the transparent member may be formed of a metal multilayer film that selectively transmits specific polarization and reflects polarization of other specific polarizations. In FIG. 2B, the polarization separator 101B is configured to transmit image light of a specific polarization output from the display device 1.

[0027] The image light that has passed through the polarization separation member 101B is incident on the retroreflector 2. A λ / 4 plate 21 is provided on the image light incident surface of the retroreflector. The image light is polarized and converted from a specific polarization to the other polarization by passing through the λ / 4 plate 21 twice, once when it enters the retroreflector and once when it leaves. Here, the polarization separation member 101B has the property of reflecting the polarized light of the other polarization that has been polarized and converted by the λ / 4 plate 21, so the image light after polarization conversion is reflected by the polarization separation member 101B. The image light reflected by the polarization separation member 101B passes through the transparent member 100 and forms a space-floating image 3, which is a real image, outside the transparent member 100.

[0028] Here, a first example of polarization design for the optical system of FIG. 2B will be described. For example, a configuration may be adopted in which P-polarized image light is emitted from display device 1 to polarization separator 101B, and polarization separator 101B has the property of reflecting S-polarized light and transmitting P-polarized light. In this case, the P-polarized image light that reaches polarization separator 101B from display device 1 passes through polarization separator 101B and proceeds to retroreflector 2. When the image light is reflected by retroreflector 2, it passes twice through λ / 4 plate 21 provided on the incident surface of retroreflector 2, and the image light is converted from P-polarized light to S-polarized light. The image light converted to S-polarized light proceeds again to polarization separator 101B. Here, polarization separator 101B has the property of reflecting S-polarized light and transmitting P-polarized light, so the S-polarized image light is reflected by polarization separator 101 and passes through transparent member 100. The image light transmitted through the transparent member 100 is light generated by the retroreflector 2, and therefore forms a space-floating image 3, which is an optical image of the image displayed on the display device 1, at a position that is in a mirror relationship with the image displayed on the display device 1 relative to the polarization separation member 101B. This polarization design allows the space-floating image 3 to be formed optimally.

[0029] Next, a second example of polarization design for the optical system of FIG. 2B will be described. For example, S-polarized image light may be emitted from display device 1 to polarization separator 101B, which may have the property of reflecting P-polarized light and transmitting S-polarized light. In this case, the S-polarized image light reaching polarization separator 101B from display device 1 passes through polarization separator 101B and proceeds to retroreflector 2. When the image light is reflected by retroreflector 2, it passes twice through λ / 4 plate 21 provided on the incident surface of retroreflector 2, converting the image light from S-polarized light to P-polarized light. The P-polarized image light then proceeds again to polarization separator 101B. Here, polarization separator 101B has the property of reflecting P-polarized light and transmitting S-polarized light, so the P-polarized image light is reflected by polarization separator 101 and passes through transparent member 100. The image light transmitted through the transparent member 100 is light generated by the retroreflector 2, and therefore forms a space-floating image 3, which is an optical image of the image displayed on the display device 1, at a position that is in a mirror relationship with the image displayed on the display device 1 relative to the polarization separation member 101B. This polarization design allows the space-floating image 3 to be formed optimally.

[0030] In FIG. 2B , the image display surface of the display device 1 and the surface of the retroreflector 2 are arranged parallel to each other. The polarization separator 101B is arranged tilted at an angle α (e.g., 30°) relative to the image display surface of the display device 1 and the surface of the retroreflector 2. When the polarization separator 101B reflects the image light, the direction of the image light reflected by the polarization separator 101B (the direction of the chief ray of the image light) differs by an angle β (e.g., 60°) from the direction of the image light incident from the retroreflector 2 (the direction of the chief ray of the image light). With this configuration, the optical system of FIG. 2B outputs the image light toward the outside of the transparent member 100 at a predetermined angle shown in the figure, forming the space-floating image 3, which is a real image. In the configuration of FIG. 2B , when a user views the space-floating image 3 from the direction of arrow A, the space-floating image 3 is perceived as a bright image. However, when another person views the space-floating image 3 from the direction of arrow B, the space-floating image 3 cannot be perceived as an image at all. This characteristic is extremely suitable for use in a system that displays images that require high security or highly confidential images that should be kept secret from people directly facing the user.

[0031] As described above, the optical system of FIG. 2B has a different configuration from the optical system of FIG. 2A, but can form a suitable floating image in space, similar to the optical system of FIG. 2A.

[0032] An absorptive polarizing plate may be provided on the surface of the transparent member 100 facing the polarization separation member 101B. This absorptive polarizing plate may transmit the polarized waves of the image light from the polarization separation member 101B and absorb the polarized waves that are 90° out of phase with the polarized waves of the image light from the polarization separation member 101B. In this way, the image light for forming the space-floating image 3 can be sufficiently transmitted while reducing the external light incident on the space-floating image 3 side of the transparent member 100 by approximately 50%. This makes it possible to reduce stray light in the optical system of FIG. 2B due to the external light incident on the space-floating image 3 side of the transparent member 100.

[0033] <Another configuration example 2 of the optical system of the space floating image display device> Another example of the configuration of the optical system of the space floating image display device will be explained using Fig. 2C. In Fig. 2C, components with the same reference numerals as Fig. 2B have the same functions and configurations as Fig. 2B. For the sake of simplicity, such components will not be described repeatedly.

[0034] The only difference between the optical system in Figure 2B and the optical system in Figure 2C is the angle at which the polarization separation member 101B is disposed relative to the image display surface of the display device 1 and the surface of the retroreflector 2. All other configurations are the same as those of the optical system in Figure 2B, so repeated explanations will be omitted. The polarization design of the optical system in Figure 2C is also the same as that of the optical system in Figure 2B, so repeated explanations will be omitted.

[0035] In the optical system of FIG. 2C , the polarization separator 101B is tilted at an angle α with respect to the image display surface of the display device 1 and the surface of the retroreflector 2. In FIG. 2C , the angle α is 45°. With this configuration, when the polarization separator 101B reflects, the angle β between the direction of propagation of the image light incident from the retroreflector 2 (the direction of the chief ray of the image light) and the direction of propagation of the image light reflected by the polarization separator 101B (the direction of the chief ray of the image light) is 90°. With this configuration, the image display surface of the display device 1 and the surface of the retroreflector 2 are perpendicular to the direction of propagation of the image light reflected by the polarization separator 101B, simplifying the angular relationships of the surfaces that make up the optical system. By arranging the surface of the transparent member 100 so that it is perpendicular to the direction of propagation of the image light reflected by the polarization separator 101B, the angular relationships of the surfaces that make up the optical system can be further simplified. In the configuration of Figure 2C, when a user views the floating image 3 from the direction of arrow A, the floating image 3 is perceived as a bright image. However, when another person views the floating image 3 from the direction of arrow B, the floating image 3 cannot be seen as an image at all. This characteristic is very suitable for use in a system that displays images that require high security or highly confidential images that should be kept secret from people directly facing the user.

[0036] As described above, the optical system of Fig. 2C has a different configuration from the optical systems of Fig. 2A and Fig. 2B, but can form a suitable floating image in space similar to the optical systems of Fig. 2A and Fig. 2B. In addition, the angles of the surfaces constituting the optical system can be made simpler.

[0037] An absorptive polarizer may be provided on the surface of the transparent member 100 facing the polarization separation member 101B. This absorptive polarizer may transmit the polarized waves of the image light from the polarization separation member 101B and absorb the polarized waves that are 90° out of phase with the polarized waves of the image light from the polarization separation member 101B. This allows the image light for forming the space-floating image 3 to be sufficiently transmitted while reducing the external light incident on the space-floating image 3 side of the transparent member 100 by approximately 50%. This allows the stray light in the optical system of FIG. 2C due to the external light incident on the space-floating image 3 side of the transparent member 100 to be reduced.

[0038] <Another configuration example 3 of the optical system of the space floating image display device> Another example of the configuration of the optical system of the space floating image display device will be described with reference to FIG. 2D. The optical system of FIG. 2D is an optical system that uses a retroreflector 5 that is different from the retroreflector 2 used in FIGS. 2A to 2C. Hereinafter, another example of the configuration 3 of the optical system will be described in more detail with reference to FIGS. 2D to 2I. In FIG. 2D, components that are assigned the same reference numerals as those in FIGS. 2A to 2C have the same functions and configurations as those in FIGS. 2A to 2C. For the sake of simplicity, such components will not be described repeatedly.

[0039] 2D is a diagram showing an example of the main components and retroreflection components of a space floating image display device according to one embodiment of the present invention. A display device 1 that emits image light is provided obliquely on a transparent member 100 such as glass. The display device 1 includes a liquid crystal display panel 11 and a light source device 13 that generates light.

[0040] A chief ray 9020 representing the light beam emitted from the display device 1 travels toward the retroreflector 5 and is incident on the retroreflector 5 at an incident angle α. The incident angle α may be, for example, 45°. However, the incident angle α is not limited to 45°, and may also be, for example, 45°±15°.

[0041] The retroreflector 5 is an optical element having the optical property of retroreflecting light rays in at least some directions. Furthermore, since the reflected light rays have the optical property of forming an image, the retroreflector 5 may also be referred to as an imaging optical element or an imaging optical plate.

[0042] 2E, 2F, etc., the principal ray 9020 travels in the z direction while being retroreflected in the x and y directions by the retroreflector 5. As a result, the reflected ray 9021 travels in a direction away from the retroreflector 5 along an optical path that is mirror-symmetrical with respect to the principal ray 9020 with the retroreflector 5 as the reference, passes through the transparent member 100, and forms the spatial floating image 3 as a real image on the imaging plane.

[0043] The light beam that forms the floating image 3 is a collection of light rays that converge from the retroreflector 5 to the optical image of the floating image 3, and these light rays continue to travel in a straight line even after passing through the optical image of the floating image 3. Therefore, the floating image 3 is an image with high directionality, unlike a diffuse image formed on a screen by a general projector or the like. Therefore, in the configuration of Figure 2, when a user views the floating image 3 from the direction of arrow A, the floating image 3 is perceived as a bright image. However, when another person views the floating image 3 from the direction of arrow B, the floating image 3 cannot be perceived as an image at all. This characteristic is suitable for use in a system that displays images that require high security or highly confidential images that should be kept secret from people directly facing the user.

[0044] An example of the configuration of the retroreflector 5 will be described using Figures 2E and 2F. The retroreflector 5 has a configuration in which multiple corner reflectors 9040 are arranged in an array on the surface of a transparent member. This may also be called a corner reflector array or a polyhedral reflector array. The specific configuration of the corner reflector 9040 will be described in detail using Figures 2G, 2H, and 2I. Light rays 9111, 9112, 9113, and 9114 emitted from a light source 9110 are reflected twice by two mirror surfaces 9041 and 9042 of the corner reflector 9040, becoming reflected light rays 9121, 9122, 9123, and 9124. This double reflection is retroreflection in the x and y directions, where the light returns to the same direction as the incident direction (traveling in a direction rotated 180 degrees). In the z direction, total reflection results in specular reflection, where the angle of incidence and the angle of reflection match.

[0045] That is, light rays 9111 to 9114 generate reflected light rays 9121 to 9124 on straight lines symmetrical in the z direction with respect to corner reflector 9040, and form aerial real image 9120. Note that light rays 9111 to 9114 emitted from light source 9110 are four light rays that represent the diffused light from light source 9110, and although the light rays incident on retroreflector 5 are not limited to these four light rays depending on the diffusion characteristics of light source 9110, all incident light rays cause similar reflections and form aerial real image 9120. Note that for ease of viewing the drawing, the position of light source 9110 and the position of aerial real image 9120 are shown shifted in the x direction, but in reality, the position of light source 9110 and the position of aerial real image 9120 in the x direction are the same and are overlapping when viewed from the z direction.

[0046] 2G, 2H, and 2I, the configuration and effects of the corner reflector 9040 that constitutes the retroreflector 5 will be described. The corner reflector 9040 is a rectangular parallelepiped with only two specific faces being mirror surfaces 9041 and 9042, and the other four faces being made of transparent materials. The retroreflector 5 has a configuration in which these corner reflectors 9040 are arrayed so that corresponding mirror surfaces face in the same direction.

[0047] When viewed from the top (+z direction), a light ray 9111 emitted from a light source 9110 enters the mirror surface 9041 (or the mirror surface 9042) at a specific angle of incidence, is totally reflected at a reflection point 9130, and then is totally reflected again at a reflection point 9132 on the mirror surface 9042 (or the mirror surface 9041).

[0048] If the angle of incidence of light ray 9111 with respect to mirror surface 9041 (or mirror surface 9042) is θ, then the angle of incidence of first reflected light ray 9131 reflected by mirror surface 9041 (or mirror surface 9042) with respect to mirror surface 9042 (or mirror surface 9041) can be expressed as 90°-θ. Therefore, with respect to light ray 9111, second reflected light ray 9121 is rotated by 2θ after the first reflection and by 2×(90°-θ) after the second reflection, resulting in a total reversal optical path of 180°. On the other hand, when viewed from the side (the direction halfway between -x and -y), total reflection in the z direction occurs only once. Therefore, if the angle of incidence with respect to mirror surface 9041 or mirror surface 9042 is φ, then reflected light ray 9121 is rotated by 2×φ after one reflection with respect to light ray 9111.

[0049] As described above, light rays incident on the corner reflector 9040 undergo retroreflection, which creates an inverted optical path in the x and y directions, and specular reflection due to total reflection in the z direction. Considering the retroreflector 5, similar reflections occur in each optical path, so that an image is formed at a point symmetrical with respect to the z axis direction by an inverted optical path that is convergent in the x and y directions.

[0050] 2A to 2C, the retroreflector 2 has retroreflection properties in three axes. As a result, when a diffusive incident light beam is incident on the retroreflector 2, a convergent reflected light beam travels toward the side of the retroreflector 2 where the light source of the incident light beam is located. The convergent reflected light beam forms an image in the air, forming a space-floating image 3. The traveling direction of the chief ray of the convergent reflected light beam reflected from the retroreflector 2 is opposite to the traveling direction of the chief ray of the diffusive incident light beam incident on the retroreflector 2.

[0051] In contrast, in the optical system of Fig. 2D, the retroreflector 5 has retroreflection properties in two axial directions and specular reflection in the other axial direction. As a result, when a diffusive incident light beam is incident on the retroreflector 5, the convergent reflected light beam is reflected by the corner reflector array and travels in the direction opposite to the side of the retroreflector 5 where the light source of the incident light is located. The convergent reflected light beam forms an image in the air and forms the space floating image 3.

[0052] The traveling direction of the chief ray of the convergent reflected light beam reflected by the corner reflector array of the retroreflector 5 is not the opposite direction to the traveling direction of the chief ray of the diffusive incident light beam that is incident on the retroreflector 5. The normal direction component of the plate-shaped surface of the retroreflector 5 in the traveling direction of the chief ray of the diffusive incident light beam that is incident on the retroreflector 5 and the normal direction component of the plate-shaped surface of the retroreflector 5 in the traveling direction of the chief ray after being reflected by the retroreflector 5 and becoming a convergent reflected light beam continue to travel in a straight line, unchanged before and after reflection by the corner reflector array.

[0053] That is, the diffusive incident light beam is converted into a convergent reflected light beam by reflection on the retroreflector 5, but in the normal direction to the plate-shaped surface of the retroreflector 5, the light beam travels as if passing through the retroreflector 5. Here, the diffusive incident light beam incident on the retroreflector 5 and the convergent reflected light beam emerging from the retroreflector 5 are in a geometrically symmetrical relationship with respect to the plate-shaped surface of the retroreflector 5.

[0054] The resolution of the space-floating image formed by the light beams from the display device 1 depends not only on the resolution of the liquid crystal display panel 11 but also on the diameter D and pitch P (not shown) of the retroreflective portion of the retroreflector 5 shown in Figures 2E and 2F. For example, when using a 7-inch WUXGA (1920 x 1200 pixels) liquid crystal display panel, even if one pixel (one triplet) is approximately 80 μm, if the diameter D of the retroreflective portion is 240 μm and the pitch P is 300 μm, one pixel of the space-floating image will be equivalent to 300 μm. As a result, the effective resolution of the space-floating image will be reduced to about one-third.

[0055] Therefore, in order to make the resolution of the spatial floating image equivalent to that of the display device 1, it is desirable to make the diameter D and pitch P of the retroreflective portion close to one pixel of the liquid crystal display panel. On the other hand, to suppress the occurrence of moire caused by the retroreflective plate and the pixels of the liquid crystal display panel, it is advisable to design the pitch ratio of each to be a different integer multiple of one pixel. Also, it is advisable to arrange the shape so that none of the sides of the retroreflective portion overlaps with any of the sides of one pixel of the liquid crystal display panel.

[0056] The shape of the retroreflector (imaging optical plate) according to this embodiment is not limited to the above example. It may have various shapes that achieve retroreflection. Specifically, it may be a variety of cubic corner bodies, a corner reflector array, a slit mirror array, a dihedral corner reflector array, a polyhedral reflector array, or a shape in which a combination of these reflective surfaces is periodically arranged. Alternatively, a capsule lens-type retroreflector element with periodically arranged glass beads may be provided on the surface of the retroreflector according to this embodiment. The detailed configuration of these retroreflectors can be achieved using existing technology, so a detailed description will be omitted. Specifically, the technology disclosed in JP 2017-33005 A, JP 2019-133110 A, JP 2017-67933 A, WO 2009 / 131128 A, etc. may be used.

[0057] 2D, the image light emitted from the display device 1 may be in any polarization state, either S-polarized or P-polarized.

[0058] As explained above, the optical system of Figure 2D is an optical system that uses a retroreflector different from the optical systems of Figures 2A to 2C, but it can form a more suitable floating image in space, similar to the optical systems of Figures 2A to 2C.

[0059] According to the optical systems of FIGS. 2A, 2B, 2C, and 2D described above, it is possible to provide brighter, higher quality floating images in space.

[0060] <<Block diagram of the internal configuration of the space floating image display device>> Next, a description will be given of a block diagram of the internal configuration of the space-floating image display device 1000. Fig. 3 is a block diagram showing an example of the internal configuration of the space-floating image display device 1000.

[0061] The space-floating image display device 1000 includes a retroreflection unit 1101, an image display unit 1102, a light guide 1104, a light source 1105, a power supply 1106, an external power supply input interface 1111, an operation input unit 1107, a nonvolatile memory 1108, a memory 1109, a control unit 1110, a video signal input unit 1131, an audio signal input unit 1133, a communication unit 1132, an aerial operation detection sensor 1351, an aerial operation detection unit 1350, an audio output unit 1140, a microphone 1139, an image control unit 1160, a storage unit 1170, an imaging unit 1180, etc. In addition, the space-floating image display device 1000 may also include a removable media interface 1134, an attitude sensor 1113, a transmissive self-luminous image display device 1650, a second display device 1680, or a secondary battery 1112.

[0062] Each component of the space floating image display device 1000 is disposed in a housing 1190. The imaging unit 1180 and the mid-air operation detection sensor 1351 shown in FIG.

[0063] The retroreflector 1101 in Fig. 3 corresponds to the retroreflector 2 in Figs. 2A, 2B, and 2C. The retroreflector 1101 retroreflects light modulated by the image display unit 1102. Of the light reflected from the retroreflector 1101, the light output to the outside of the space-floating image display device 1000 forms the space-floating image 3. When the optical system in Fig. 2D is applied, the retroreflector 1101 corresponds to the retroreflector 5 in Fig. 2D.

[0064] 3 corresponds to the liquid crystal display panel 11 in FIGS. 2A, 2B, and 2C. The light source 1105 in FIG. 3 corresponds to the light source device 13 in FIGS. 2A, 2B, and 2C. The image display unit 1102, the light guide 1104, and the light source 1105 in FIG. 3 correspond to the display device 1 in FIGS. 2A, 2B, and 2C.

[0065] The video display unit 1102 is a display unit that generates a video by modulating transmitted light based on a video signal input under the control of a video control unit 1160 (described later). The video display unit 1102 (the above-described liquid crystal display panel 11) may be, for example, a transmissive liquid crystal panel, but is not limited to this. Alternatively, the video display unit 1102 may be, for example, a reflective liquid crystal panel that modulates reflected light, a DMD (Digital Micromirror Device: registered trademark) panel, or the like.

[0066] The light source 1105 generates light for the image display unit 1102 and is a solid-state light source such as an LED (Light Emitting Diode) or a laser light source. The power source 1106 converts AC current input from the outside via the external power input interface 1111 into DC current and supplies power to the light source 1105. The power source 1106 also supplies the necessary DC current to each unit within the space-floating image display device 1000. The secondary battery 1112 stores the power supplied from the power source 1106. The secondary battery 1112 also supplies power to the light source 1105 and other components that require power via the external power input interface 1111 when power is not supplied from the outside. In other words, when the space-floating image display device 1000 is equipped with the secondary battery 1112, the user can use the space-floating image display device 1000 even when power is not supplied from the outside.

[0067] The light guide 1104 guides light generated by the light source 1105 and irradiates it onto the video display unit 1102. The combination of the light guide 1104 and the light source 1105 can also be called a backlight for the video display unit 1102. The light guide 1104 may be configured mainly using glass. The light guide 1104 may be configured mainly using plastic. The light guide 1104 may be configured using a mirror. Various methods are possible for combining the light guide 1104 and the light source 1105. Specific configuration examples of the combination of the light guide 1104 and the light source 1105 will be described in detail later.

[0068] The aerial operation detection sensor 1351 is a sensor that detects an operation of the floating in space image 3 by an operating object such as a user's finger. The aerial operation detection sensor 1351 senses, for example, an area that overlaps with the entire display area of ​​the floating in space image 3. Note that the aerial operation detection sensor 1351 may only sense an area that overlaps with at least a portion of the display area of ​​the floating in space image 3.

[0069] Specific examples of the aerial operation detection sensor 1351 include a distance sensor that uses invisible light such as infrared light, an invisible laser, ultrasonic waves, etc. The aerial operation detection sensor 1351 may also be configured to detect coordinates on a two-dimensional plane by combining multiple sensors. The aerial operation detection sensor 1351 may also be configured with a ToF (Time of Flight) LiDAR (Light Detection and Ranging) or an image sensor.

[0070] The mid-air operation detection sensor 1351 only needs to be capable of sensing to detect touch operations with the user's finger on objects displayed as the floating-in-space image 3. Such sensing can be performed using existing technology.

[0071] The aerial operation detection unit 1350 acquires a sensing signal from the aerial operation detection sensor 1351, and, based on the sensing signal, determines whether or not the user's finger has made contact with an object in the floating in space image 3, and calculates the position (contact position) where the user's finger has made contact with the object. The aerial operation detection unit 1350 is configured, for example, by a circuit such as an FPGA (Field Programmable Gate Array). Furthermore, some of the functions of the aerial operation detection unit 1350 may be realized by software, for example, by a program for detecting aerial operation executed by the control unit 1110 or the image control unit 1160. The aerial operation detection sensor 1351 and the aerial operation detection unit 1350 may be configured as an integrated unit. The aerial operation detection unit 1350 and the control unit 1110 or the image control unit 1160 may be configured as an integrated unit.

[0072] The aerial operation detection sensor 1351 and the aerial operation detection unit 1350 may be configured to be built into the space-floating image display device 1000, or may be provided externally as a separate entity from the space-floating image display device 1000. When provided as a separate entity from the space-floating image display device 1000, the aerial operation detection sensor 1351 and the aerial operation detection unit 1350 are configured to be able to transmit information and signals to the space-floating image display device 1000 via a wired or wireless communication connection path or a video signal transmission path. This makes it possible to build a system in which the space-floating image display device 1000, which does not have aerial operation detection function, is used as the main body, and only the aerial operation detection function can be added as an option.

[0073] Also, the aerial operation detection sensor 1351 may be a separate unit, and the aerial operation detection unit 1350 may be built into the space-floating image display device 1000. In cases where it is desired to more freely arrange the aerial operation detection sensor 1351 relative to the installation position of the space-floating image display device 1000, there is an advantage to a configuration in which only the aerial operation detection sensor 1351 is a separate unit.

[0074] The imaging unit 1180 is a camera with an image sensor, and captures images of the space near the space-floating image 3 and / or the face, arms, fingers, etc. of the user 230. A plurality of imaging units 1180 may be provided. For example, the imaging unit 1180 may be provided as a stereo camera. By using a plurality of imaging units 1180, or by using an imaging unit with a depth sensor, the mid-air operation detection unit 1350 can be assisted in detecting the touch operation of the space-floating image 3 by the user 230. The imaging unit 1180 may be provided separately from the space-floating image display device 1000. When the imaging unit 1180 is provided separately from the space-floating image display device 1000, it is sufficient to configure it so that an imaging signal can be transmitted to the space-floating image display device 1000 via a wired or wireless communication connection path, etc.

[0075] For example, if the aerial operation detection sensor 1351 is configured as an object intrusion sensor that targets a plane (intrusion detection plane) including the display surface (display range) of the spatial floating image 3 and detects whether or not an object has intruded into this intrusion detection plane, the aerial operation detection sensor 1351 may not be able to detect information such as how far an object (e.g., a user's finger) that has not intruded into the intrusion detection plane is from the intrusion detection plane, or how close the object is to the intrusion detection plane.

[0076] In such a case, the distance between the object and the intrusion detection plane (space floating image 3) can be calculated by using information such as object depth calculation information based on captured images from the multiple imaging units 1180 and object depth information from a depth sensor. Then, various information such as this depth calculation information, depth information, and distance between the object and the intrusion detection plane is used for various display controls for the space floating image 3.

[0077] Furthermore, without using the aerial operation detection sensor 1351, the aerial operation detection unit 1350 may detect a touch operation on the floating-in-space image 3 by the user 230 based on the captured image of the imaging unit 1180. In this case, the imaging unit 1180 may be referred to as an aerial operation detection sensor.

[0078] Furthermore, the imaging unit 1180 may capture an image of the face of the user operating the space-floating image 3, and the control unit 1110 or the like may perform a process to identify the user. Furthermore, in order to determine whether or not there is another person standing around or behind the user operating the space-floating image 3 and peeking at the user's operation of the space-floating image 3, the imaging unit 1180 may capture an image of the user operating the space-floating image 3 and a range including the user's surrounding area.

[0079] The operation input unit 1107 is, for example, an operation button, a signal receiving unit such as a remote controller, or an infrared light receiving unit, and inputs signals for operations different from the user's air operation (touch operation). Apart from the above-mentioned user who touches the space floating image 3, the operation input unit 1107 may also be used by, for example, an administrator to operate the space floating image display device 1000.

[0080] The video signal input unit 1131 is connected to an external video output device and inputs video data (video signals). The video signal input unit 1131 can be implemented using various digital video input interfaces. For example, it may be configured with a video input interface conforming to the HDMI (registered trademark) (High-Definition Multimedia Interface) standard, a video input interface conforming to the DVI (Digital Visual Interface) standard, or a video input interface conforming to the DisplayPort standard. Alternatively, an analog video input interface such as analog RGB or composite video may be provided.

[0081] The audio signal input unit 1133 is connected to an external audio output device and inputs audio data (audio signals). The audio signal input unit 1133 may be configured as an audio input interface conforming to the HDMI standard, an optical digital terminal interface, a coaxial digital terminal interface, or the like. In the case of an interface conforming to the HDMI standard, the video signal input unit 1131 and the audio signal input unit 1133 may be configured as an interface in which a terminal and a cable are integrated.

[0082] The audio output unit 1140 can output audio based on audio data input to the audio signal input unit 1133. The audio output unit 1140 may be configured with a speaker 1140. The audio output unit 1140 may also include a section that performs voice synthesis processing, etc. The audio output unit 1140 may also output built-in operation sounds and error warning sounds. Alternatively, the audio output unit 1140 may be configured to output a digital signal to an external device, like the Audio Return Channel function defined in the HDMI standard.

[0083] The audio input unit 1139 may be configured with a microphone 1139. The microphone 1139 is a microphone that collects sounds around the space-floating image display device 1000, converts them into signals, and generates audio signals. The microphone may record a person's voice, such as a user's voice, and the control unit 1110 or the like performs voice recognition processing on the generated audio signal to obtain text information from the audio signal. The audio input unit 1139 may be provided with a part that performs voice recognition processing or the like. Note that the audio output unit 1140, the audio input unit 1139, etc. may be connected as external devices to the space-floating image display device 1000.

[0084] The nonvolatile memory 1108 stores various data used by the space-floating image display device 1000. The data stored in the nonvolatile memory 1108 includes, for example, data for various operations to be displayed on the space-floating image 3, display icons, data of objects for the user to operate, layout information, etc. The memory 1109 stores image data to be displayed as the space-floating image 3, data for controlling the device, etc.

[0085] The control unit 1110 includes a processor and controls the operation of each connected unit. The control unit 1110 may also work in cooperation with a program stored in the memory 1109 to perform calculations based on information acquired from each unit in the space floating image display device 1000.

[0086] The communication unit 1132 communicates with external devices, external servers, etc. via a wired or wireless communication interface. If the communication unit 1132 has a wired communication interface, the wired communication interface may be configured, for example, as an Ethernet LAN interface. If the communication unit 1132 has a wireless communication interface, the interface may be configured, for example, as a Wi-Fi communication interface, a Bluetooth communication interface, or a mobile communication interface such as 4G or 5G. Various types of data, such as video data, image data, and audio data, are transmitted and received through communication via the communication unit 1132.

[0087] The removable media interface 1134 is an interface for connecting a removable recording medium (removable media). The removable recording medium (removable media) may be composed of a semiconductor device memory such as a solid state drive (SSD), a magnetic recording medium recording device such as a hard disk drive (HDD), or an optical recording medium such as an optical disk. The removable media interface 1134 can read various information such as video data, image data, and audio data recorded on the removable recording medium. The video data, image data, etc. recorded on the removable recording medium are output as the floating image 3 via the video display unit 1102 and the retroreflection unit 1101.

[0088] The storage unit 1170 is a storage device that records various types of information such as video data, image data, audio data, etc. The storage unit 1170 may be configured with a magnetic recording medium recording device such as a hard disk drive (HDD), or a semiconductor element memory such as a solid state drive (SSD). For example, various types of information such as video data, image data, audio data, etc. may be recorded in advance in the storage unit 1170 at the time of product shipment. Furthermore, the storage unit 1170 may record various types of information such as video data, image data, audio data, etc. acquired from an external device, an external server, etc. via the communication unit 1132.

[0089] The video data, image data, etc. recorded in the storage unit 1170 are output as the space floating image 3 via the video display unit 1102 and the retroreflection unit 1101 based on processing by the video control unit 1160. Video data, image data, etc. of display icons, objects for user operation, etc. displayed as the space floating image 3 are also recorded in the storage unit 1170. Layout information of the display icons, objects, etc. displayed as the space floating image 3, and various metadata information related to the objects, etc. are also recorded in the storage unit 1170.

[0090] The audio data recorded in the storage unit 1170 is output as audio from the audio output unit 1140, for example.

[0091] The video control unit 1160 performs various controls related to the video signal input to the video display unit 1102. Based on the video signal (video data), the video control unit 1160 creates a video signal (display data) for displaying a video on the video display unit 1102 (for example, the liquid crystal display panel 11 of the display device 1 described above), and supplies the video signal to the video display unit 1102. The video control unit 1160 may be referred to as a video processing circuit, and may be configured with hardware such as an ASIC, FPGA, or video processor. The video control unit 1160 may also be referred to as a video processing unit or an image processing unit. The video control unit 1160 performs video switching control, such as determining which video signal to input to the video display unit 1102, between the video signal to be stored in the memory 1109 and the video signal (video data) input to the video signal input unit 1131.

[0092] Note that the control unit 1110 may perform the same processing as the video control unit 1160, in which case the control unit 1110 may be referred to as a video processing unit, etc. At least one of the control unit 1110, the video control unit 1160, the aerial operation detection unit 1360, etc. may perform unique control processing, in which case the control unit 1110, the video control unit 1160, the aerial operation detection unit 1360, etc. may be referred to as a video processing unit.

[0093] In addition, the video control unit 1160 may generate a superimposed video signal by superimposing the video signal to be stored in the memory 1109 and the video signal input from the video signal input unit 1131, and input the superimposed video signal to the video display unit 1102, thereby performing control to form the composite video as the floating-in-space video 3.

[0094] Furthermore, the video control unit 1160 may control image processing of the video signal input from the video signal input unit 1131, the video signal to be stored in the memory 1109, etc. Examples of image processing include scaling processing to enlarge, reduce, deform, etc. the image, brightness adjustment processing to change the brightness, contrast adjustment processing to change the contrast curve of the image, and Retinex processing to decompose the image into light components and change the weighting of each component.

[0095] Furthermore, the video control unit 1160 may perform special effect video processing or the like to assist the user's mid-air operation (touch operation) on the video signal input to the video display unit 1102. The special effect video processing is performed, for example, based on the detection result of the user's touch operation by the mid-air operation detection unit 1350, or on the image of the user captured by the imaging unit 1180. Furthermore, the video control unit 1160 or the like may perform audio control processing when audio is output from the audio output unit 1140 simultaneously with the floating-in-space video 3. An audio control unit for this audio control processing may be provided separately from the video control unit 1160.

[0096] The attitude sensor 1113 is a sensor configured by a gravity sensor or an acceleration sensor, or a combination of these, and can detect the attitude in which the space-floating image display device 1000 is installed. Based on the attitude detection result of the attitude sensor 1113, the control unit 1110 may control the operation of each connected unit. For example, when an undesirable attitude in the user's usage state is detected, the control unit 1110 may perform control such that the image being displayed on the image display unit 1102 is stopped and an error message is displayed to the user. Alternatively, when the attitude sensor 1113 detects a change in the installation attitude of the space-floating image display device 1000, the control unit 1110 may perform control such that the display direction of the image being displayed on the image display unit 1102 is rotated.

[0097] As explained above, various functions are installed in the space-floating image display device 1000. However, the space-floating image display device 1000 does not need to have all of these functions, and any configuration is acceptable as long as it has the function of forming the space-floating image 3.

[0098] <Configuration example of a space floating image display device> Next, a configuration example of the space-floating image display device will be described. The layout of the components of the space-floating image display device according to this embodiment can be various depending on the usage form. Below, the layouts of each of Figs. 4A to 4P will be described. In addition, in each example of Figs. 4A to 4P, the thick lines surrounding the components (display device 1, etc.) of the space-floating image display device 1000 show an example of the housing structure (housing 1190 in Fig. 3) of the space-floating image display device 1000.

[0099] FIG. 4A is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4A is equipped with an optical system corresponding to the optical system of FIG. 2A. The space-floating image display device 1000 shown in FIG. 4A is installed horizontally so that the surface on which the space-floating image 3 is formed faces upward. That is, in FIG. 4A, the space-floating image display device 1000 has a transparent member 100 installed on the top surface of the device. The space-floating image 3 is formed above the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels diagonally upward. When the mid-air operation detection sensor 1351 is installed as shown in the figure, it can detect the operation of the space-floating image 3 by the finger of the user 230. Note that the x direction is the left-right direction as seen from the user, the y direction is the front-back direction (depth direction) as seen from the user, and the z direction is the up-down direction (vertical direction). Hereinafter, the definitions of the x direction, y direction, and z direction are the same in each drawing of FIG. 4, so repeated explanations will be omitted.

[0100] FIG. 4B is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4B is equipped with an optical system corresponding to the optical system of FIG. 2A. The space-floating image display device 1000 shown in FIG. 4B is installed vertically so that the surface on which the space-floating image 3 is formed faces the front of the space-floating image display device 1000 (toward the user 230). That is, in FIG. 4B, the space-floating image display device is installed with the transparent member 100 facing the front of the device (toward the user 230). The space-floating image 3 is formed on the user 230 side of the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels diagonally upward. If the mid-air operation detection sensor 1351 is provided as shown in the figure, it can detect the operation of the space-floating image 3 by the finger of the user 230. 4B, the mid-air operation detection sensor 1351 can use the reflection of sensing light by the user's nail for touch detection by sensing the finger of the user 230 from above. Generally, the reflectivity of the nail is higher than that of the finger pad, so this configuration can improve the accuracy of touch detection.

[0101] FIG. 4C is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4C is equipped with an optical system corresponding to the optical system of FIG. 2B. The space-floating image display device 1000 shown in FIG. 4C is installed horizontally so that the surface on which the space-floating image 3 is formed faces upward. That is, in FIG. 4C, the space-floating image display device 1000 has a transparent member 100 installed on the top surface of the device. The space-floating image 3 is formed above the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels diagonally upward. If the mid-air operation detection sensor 1351 is provided as shown in the figure, it can detect the operation of the space-floating image 3 by the user's 230 finger.

[0102] FIG. 4D is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4D is equipped with an optical system corresponding to the optical system of FIG. 2B. The space-floating image display device 1000 shown in FIG. 4D is installed vertically so that the surface on which the space-floating image 3 is formed faces the front of the space-floating image display device 1000 (toward the user 230). That is, in FIG. 4D, the space-floating image display device 1000 is installed with the transparent member 100 facing the front of the device (toward the user 230). The space-floating image 3 is formed on the user 230 side of the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels diagonally upward. If the mid-air operation detection sensor 1351 is provided as shown in the figure, it can detect the operation of the space-floating image 3 by the user 230's finger. 4D, the mid-air operation detection sensor 1351 can use the reflection of sensing light by the user's nail for touch detection by sensing the finger of the user 230 from above. Generally, the reflectivity of the nail is higher than that of the finger pad, so this configuration can improve the accuracy of touch detection.

[0103] FIG. 4E is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4E is equipped with an optical system corresponding to the optical system of FIG. 2C. The space-floating image display device 1000 shown in FIG. 4E is installed horizontally so that the surface on which the space-floating image 3 is formed faces upward. That is, in FIG. 4E, the space-floating image display device 1000 has a transparent member 100 installed on the top surface of the device. The space-floating image 3 is formed above the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels directly upward. If the mid-air operation detection sensor 1351 is provided as shown in the figure, it can detect the operation of the space-floating image 3 by the finger of the user 230.

[0104] FIG. 4F is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4F is equipped with an optical system corresponding to the optical system of FIG. 2C. The space-floating image display device 1000 shown in FIG. 4F is installed vertically so that the surface on which the space-floating image 3 is formed faces the front of the space-floating image display device 1000 (toward the user 230). That is, in FIG. 4F, the space-floating image display device 1000 is installed with the transparent member 100 facing the front of the device (toward the user 230). The space-floating image 3 is formed on the user 230 side of the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels toward the user. If the mid-air operation detection sensor 1351 is provided as shown in the figure, it can detect the operation of the space-floating image 3 by the user 230's finger.

[0105] FIG. 4G is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4G is equipped with an optical system corresponding to the optical system shown in FIG. 2C. In the optical systems of the space-floating image display devices shown in FIGS. 4A to 4F, the central optical path of the image light emitted from the display device 1 was on the yz plane. That is, in the optical systems of the space-floating image display devices shown in FIGS. 4A to 4F, the image light traveled in the front-to-back and up-to-down directions as seen from the user. In contrast, in the optical system of the space-floating image display device shown in FIG. 4G, the central optical path of the image light emitted from the display device 1 is on the xy plane. That is, in the optical system of the space-floating image display device shown in FIG. 4G, the image light travels in the left-to-right and front-to-back directions as seen from the user. The space-floating image display device 1000 shown in FIG. 4G is installed so that the surface on which the space-floating image 3 is formed faces the front of the device (toward the user 230). That is, in Fig. 4G, the space-floating image display device 1000 has the transparent member 100 installed on the front side of the device (toward the user 230). The space-floating image 3 is formed on the user side of the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels towards the user. If the mid-air operation detection sensor 1351 is installed as shown in the figure, it can detect the operation of the space-floating image 3 by the finger of the user 230.

[0106] FIG. 4H is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of FIG. 4H differs from the space-floating image display device of FIG. 4G in that it has a window with a transparent plate 100B made of glass or plastic on the back of the device (opposite the position where the user 230 views the space-floating image 3, i.e., opposite the traveling direction of the image light of the space-floating image 3 toward the user 230). The rest of the configuration is the same as that of the space-floating image display device of FIG. 4G, so repeated explanations will be omitted. The space-floating image display device 1000 of FIG. 4H has a window with a transparent plate 100B on the opposite side of the traveling direction of the image light of the space-floating image 3 from the space-floating image 3. Therefore, when the user 230 views the space-floating image 3, they can recognize the scenery behind the space-floating image display device 1000 as the background of the space-floating image 3. Therefore, the user 230 can perceive the space floating image 3 as floating in the air in front of the scenery behind the space floating image display device 1000. This can further emphasize the floating feeling of the space floating image 3.

[0107] Depending on the polarization distribution of the image light output from the display device 1 and the performance of the polarization separation member 101B, a portion of the image light output from the display device 1 may be reflected by the polarization separation member 101B and head toward the transparent plate 100B. Depending on the coating performance of the surface of the transparent plate 100B, this light may be reflected again by the surface of the transparent plate 100B and may be visually recognized by the user 230 as stray light. Therefore, in order to prevent this stray light, the transparent plate 100B may not be provided at the window on the back of the space-floating image display device 1000.

[0108] Fig. 4I is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of Fig. 4I is different from the space-floating image display device of Fig. 4H in that a light-blocking door 1410 is provided in the window of the transparent plate 100B located on the back of the device (opposite the position where the user 230 views the space-floating image 3). The other configurations are the same as those of the space-floating image display device of Fig. 4H, so repeated explanations will be omitted.

[0109] The opening and closing door 1410 of the space-floating image display device 1000 in FIG. 4I has, for example, a light blocking plate, and is equipped with a mechanism for moving (sliding), rotating, or attaching / detaching the light blocking plate, thereby switching between an open state and a light blocking state for the window (rear window) of the transparent plate 100B located at the back of the space-floating image display device 1000. The movement (sliding) and rotation of the light blocking plate by the opening and closing door 1410 may be electrically driven by a motor (not shown). The motor may be controlled by the control unit 1110 in FIG. 3. Note that the example in FIG. 4I discloses an example in which the opening and closing door 1410 has two light blocking plates. In contrast, the opening and closing door 1410 may have only one light blocking plate.

[0110] For example, when the view seen through the window of the transparent plate 100B of the space-floating image display device 1000 is outdoors, the brightness of sunlight varies depending on the weather. When the outdoor sunlight is strong, the background of the space-floating image 3 may become too bright, reducing the user 230's visibility of the space-floating image 3. In such a case, by moving (sliding), rotating, or attaching the light blocking plate of the opening / closing door 1410 to block the light from the rear window, the background of the space-floating image 3 becomes dark, thereby relatively increasing the visibility of the space-floating image 3. Such a blocking operation by the light blocking plate of the opening / closing door 1410 may be performed directly by the force of the user 230's hand. In response to an operation input via the operation input unit 1107 of FIG. 3, the control unit 1110 may control a motor (not shown) to perform the blocking operation by the light blocking plate of the opening / closing door 1410.

[0111] An illuminance sensor may be provided on the rear side (opposite the user 230) of the space-floating image display device 1000, such as near the rear window, to measure the brightness of the space beyond the rear window. In this case, the control unit 1110 of Fig. 3 may control a motor (not shown) to perform the opening and closing operation of the light blocking plate of the opening and closing door 1410 according to the detection result of the illuminance sensor. By controlling the opening and closing operation of the light blocking plate of the opening and closing door 1410 in this way, it becomes possible to more suitably maintain the visibility of the space-floating image 3, even if the user 230 does not manually open and close the light blocking plate of the opening and closing door 1410.

[0112] Furthermore, the light blocking plate by the opening and closing door 1410 may be manually detachable. Depending on the intended use and installation environment of the space floating image display device 1000, the user can select whether to leave the rear window open or in a light blocking state. If it is planned to use the rear window in a light blocking state for a long period of time, the detachable light blocking plate can be fixed in the light blocking state. Also, if it is planned to use the rear window in an open state for a long period of time, it can be used with the detachable light blocking plate removed. The light blocking plate may be attached and detached using screws, a hook structure, or a fitting structure.

[0113] Even in the example of the space-floating image display device 1000 shown in FIG. 4I, depending on the polarization distribution of the image light output from the display device 1 and the performance of the polarization separator 101B, a portion of the image light output from the display device 1 may be reflected by the polarization separator 101B and directed toward the transparent plate 100B. Depending on the coating performance of the surface of the transparent plate 100B, this light may be reflected again by the surface of the transparent plate 100B and be visible to the user 230 as stray light. Therefore, to prevent this stray light, the window on the back of the space-floating image display device 1000 may not be provided with the transparent plate 100B. The above-described opening / closing door 1410 may be provided in a window that does not have the transparent plate 100B. To prevent this stray light, it is desirable that the inner surface of the housing of the light-shielding plate of the above-described opening / closing door 1410 have a coating or material with low light reflectance.

[0114] FIG. 4J is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of FIG. 4J differs from the space-floating image display device of FIG. 4H in that instead of the transparent plate 100B made of glass or plastic being placed on the rear side window, an electronically controlled transmittance variable device 1620 is placed. The other components are the same as those of the space-floating image display device of FIG. 4H, so repeated explanations will be omitted. An example of the electronically controlled transmittance variable device 1620 is a liquid crystal shutter. Although the electronically controlled transmittance variable device 1620 is not shown in FIG. 3, if it is provided, it may be configured as one component of the space-floating image display device 1000 of FIG. 3 and connected to other processing units such as the control unit 1110.

[0115] The liquid crystal shutter can control the light transmittance by controlling the voltage of the liquid crystal element sandwiched between two polarizing plates. Therefore, if the liquid crystal shutter is controlled to increase the transmittance, the scenery through the rear window can be seen through the background of the floating image 3. On the other hand, if the liquid crystal shutter is controlled to decrease the transmittance, the scenery through the rear window can be hidden as the background of the floating image 3.

[0116] Furthermore, because the liquid crystal shutter can control halftones, it can also be set to a state of transmittance of 50% or the like. For example, the control unit 1110 can control the transmittance of the electronically controlled transmittance variable device 1620 in response to an operation input via the operation input unit 1107 in Fig. 3. With this configuration, in cases where a viewer wants to see the scenery through the rear window as the background of the Space Floating Image 3, but the scenery through the rear window as the background is too bright and reduces the visibility of the Space Floating Image 3, it is possible to adjust the transmittance of the electronically controlled transmittance variable device 1620 and thereby adjust the visibility of the Space Floating Image 3.

[0117] In addition, an illuminance sensor may be provided on the back side (opposite the user 230) of the space-floating image display device 1000, such as near the rear window, to measure the brightness of the space beyond the rear window. In this case, the control unit 1110 in Fig. 3 controls the transmittance of the electronically controlled transmittance variable device 1620 according to the detection result of the illuminance sensor. In this way, even if the user 230 does not perform an operation input via the operation input unit 1107 in Fig. 3, the transmittance of the electronically controlled transmittance variable device 1620 can be adjusted according to the brightness of the space beyond the rear window, making it possible to more suitably maintain the visibility of the space-floating image 3.

[0118] In the above example, a liquid crystal shutter has been described as an example of the electronically controlled variable transmittance device 1620. However, electronic paper may be used as another example of the electronically controlled variable transmittance device 1620. The same effects as those described above can be obtained when electronic paper is used. Furthermore, electronic paper consumes very little power to maintain a halftone state. Therefore, a space floating image display device with lower power consumption can be realized compared to when a liquid crystal shutter is used.

[0119] Fig. 4K is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of Fig. 4K differs from the space-floating image display device of Fig. 4G in that it has a transmissive self-luminous image display device 1650 instead of the transparent member 100. The other configurations are the same as those of the space-floating image display device of Fig. 4G, so repeated explanations will be omitted.

[0120] In the space-floating image display device 1000 of FIG. 4K, a light beam of an image passes through the display surface of the transmissive self-luminous image display device 1650, and then a space-floating image 3 is formed outside the space-floating image display device 1000. That is, when an image is displayed on the transmissive self-luminous image display device 1650, which is a two-dimensional flat display, the space-floating image 3 can be displayed as a pop-up image further in front of the image displayed on the transmissive self-luminous image display device 1650. In this case, the user 230 can simultaneously view two images at different depth positions. The transmissive self-luminous image display device 1650 may be configured using existing technology such as a transmissive organic EL panel disclosed in, for example, Japanese Patent Application Laid-Open No. 2014-216761. When the transmissive self-luminous image display device 1650 is provided, it may be configured to be connected to other processing units such as the control unit 1110 as a component of the space-floating image display device 1000 of FIG. 3.

[0121] Here, if the transmissive self-luminous video display device 1650 displays both the background and an object such as a character, and then displays only the object such as the character moving to the front of the floating video image 3, it is possible to provide the user 230 with a more effective video experience with a surprise effect.

[0122] Furthermore, if the inside of the space-floating image display device 1000 (housing 1190) is kept in a light-blocking state, the background of the transmissive self-luminous image display device 1650 will be sufficiently dark. Therefore, when no image is displayed on the display device 1 or the light source of the display device 1 is turned off and an image is displayed only on the transmissive self-luminous image display device 1650, the transmissive self-luminous image display device 1650 appears to the user 230 as a normal two-dimensional flat display rather than a transmissive display. Note that, since the space-floating image 3 in the embodiment of the present invention is displayed as a real optical image in a space without a screen, if the light source of the display device 1 is turned off, the intended display position of the space-floating image 3 becomes empty space. Therefore, when the transmissive self-luminous image display device 1650 is used to display an image as if it were a normal two-dimensional flat display, characters, objects, etc. can be suddenly displayed in the air as the space-floating image 3, thereby providing the user 230 with a more effective surprise video experience.

[0123] Note that the darker the interior of the space-floating image display device 1000, the more the transmissive self-luminous image display device 1650 appears like a two-dimensional flat display. Therefore, an absorptive polarizer (not shown) that transmits the polarized waves of the image light reflected by the polarization separation member 101B and absorbs polarized waves that are 90° out of phase with the polarized waves may be provided on the surface of the transmissive self-luminous image display device 1650 facing the interior of the space-floating image display device 1000 (the surface where the image light reflected by the polarization separation member 101B enters the transmissive self-luminous image display device 1650, i.e., the surface of the transmissive self-luminous image display device 1650 opposite the space-floating image 3). This does not have a significant effect on the image light that forms the space-floating image 3, but it can significantly reduce the light that enters the interior of the space-floating image display device 1000 from the outside through the transmissive self-luminous image display device 1650, making the interior of the space-floating image display device 1000 darker, which is preferable.

[0124] 4L is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of FIG. 4L is a modified example of the space-floating image display device of FIG. 4K. The orientation of the components in the space-floating image display device 1000 is different from that of the space-floating image display device of FIG. 4K, and is closer to the arrangement of the space-floating image display device of FIG. 4F. The functions and operations of each component are the same as those of the space-floating image display device of FIG. 4K, so repeated explanations will be omitted.

[0125] In the space-floating image display device of FIG. 4L, after the luminous flux of image light passes through the transmissive self-luminous image display device 1650, a space-floating image 3 is formed on the user 230 side of the transmissive self-luminous image display device 1650.

[0126] In both the example of the space-floating image display device of FIG. 4K and the example of the space-floating image display device of FIG. 4L, the space-floating image 3 is displayed superimposed on the image of the transmissive self-luminous image display device 1650 as seen by the user 230. Here, the position of the space-floating image 3 and the position of the image of the transmissive self-luminous image display device 1650 are configured to have a difference in the depth direction. Therefore, when the user 230 moves his / her head (position of viewpoint), the user can recognize the depth of the two images due to parallax. Therefore, by displaying two images at different depth positions, a three-dimensional image experience can be more suitably provided to the user with the naked eye, without the need for stereoscopic glasses or the like.

[0127] Fig. 4M is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of Fig. 4M is provided with a second display device 1680 on the far side (for example, the back panel of the housing 1190) as seen from the user 230 relative to the polarization separation member 101B of the space-floating image display device of Fig. 4G. The other configurations are the same as those of the space-floating image display device of Fig. 4G, so repeated explanations will be omitted.

[0128] In the configuration example shown in FIG. 4M, the second display device 1680 is provided behind the display position of the space-floating image 3, and its image display surface faces the space-floating image 3. With this configuration, from the user 230's perspective, the image of the second display device 1680 and the space-floating image 3, which are displayed at two different depth positions, can be viewed as overlapping images. In other words, the second display device 1680 can be said to be arranged so as to display an image in the direction of the user 230 who views the space-floating image 3. When the second display device 1680 is provided, it may be configured to be connected to other processing units such as the control unit 1110 as one component of the space-floating image display device 1000 of FIG. 3.

[0129] Note that the image light of the second display device 1680 of the space-floating image display device 1000 of FIG. 4M is viewed by the user 230 after passing through the polarization separator 101B. Therefore, in order for the image light of the second display device 1680 to more suitably pass through the polarization separator 101B, it is desirable that the image light output from the second display device 1680 be polarized in a vibration direction that the polarization separator 101B more suitably transmits. That is, it is desirable that the image light be polarized in the same vibration direction as the polarization of the image light output from the display device 1. For example, if the image light output from the display device 1 is S-polarized, it is desirable that the image light output from the second display device 1680 is also S-polarized. Furthermore, if the image light output from the display device 1 is P-polarized, it is desirable that the image light output from the second display device 1680 is also P-polarized.

[0130] The example of the space-floating image display device of FIG. 4M also has the same effect as the example of the space-floating image display device of FIG. 4K and the example of the space-floating image display device of FIG. 4L in that a second image is displayed behind the space-floating image 3. However, unlike the example of the space-floating image display device of FIG. 4K and the example of the space-floating image display device of FIG. 4L, in the example of the space-floating image display device of FIG. 4M, the luminous flux of image light for forming the space-floating image 3 does not pass through the second display device 1680. Therefore, the second display device 1680 does not need to be a transmissive self-luminous image display device, but may be a liquid crystal display, which is a two-dimensional flat display. The second display device 1680 may also be an organic EL display. Therefore, the example of the space-floating image display device of FIG. 4M can realize the space-floating image display device 1000 at a lower cost than the example of the space-floating image display device of FIG. 4K and the example of the space-floating image display device of FIG. 4L.

[0131] Here, depending on the polarization distribution of the image light output from the display device 1 and the performance of the polarization separation member 101B, a portion of the image light output from the display device 1 may be reflected by the polarization separation member 101B and travel toward the second display device 1680. This light (a portion of the image light) may be reflected again by the surface of the second display device 1680 and may be visually recognized by the user as stray light.

[0132] Therefore, to prevent this stray light, an absorptive polarizer may be provided on the surface of the second display device 1680. In this case, the absorptive polarizer may be an absorptive polarizer that transmits the polarized waves of the image light output from the second display device 1680 and absorbs polarized waves that are 90° out of phase with the polarized waves of the image light output from the second display device 1680. If the second display device 1680 is a liquid crystal display, an absorptive polarizer is also provided on the image output side of the liquid crystal display. However, if there is a cover glass (cover glass on the image display surface side) on the output surface of the absorptive polarizer on the image output side of the liquid crystal display, it is not possible to prevent stray light caused by reflection of the cover glass by light from outside the liquid crystal display. Therefore, it is necessary to separately provide the above-mentioned absorptive polarizer on the surface of the cover glass.

[0133] When an image is displayed on the second display device 1680, which is a two-dimensional flat display, the floating-in-space image 3 can be displayed as an image further in front of the image on the second display device 1680. In this case, the user 230 can simultaneously view two images at different depth positions. By displaying a character on the floating-in-space image 3 and a background on the second display device 1680, it is possible to provide the effect that the user 230 is viewing the space in which the character exists in three dimensions.

[0134] Furthermore, if the second display device 1680 displays both the background and an object such as a character, and then displays only the object such as the character moving to the front of the floating image 3, it is possible to provide the user 230 with a more effective surprise visual experience.

[0135] Next, Fig. 4N is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 of Fig. 4N is a space-floating image display device that employs the optical system of Fig. 2D. In the space-floating image display device 1000 of Fig. 4N, similar to the examples of the space-floating image display device that employ the optical systems of Figs. 2A to 2C, image light that has passed through a transparent member 100 is formed in the air as a space-floating image 3. Furthermore, using sensing light from an aerial operation detection sensor 1351 that is arranged on the far side of the transparent member 100 as seen from the user, it is possible to detect operation of the space-floating image 3 by the user's finger 9004.

[0136] In both the example of the space-floating image display device employing the optical system of FIGS. 2A to 2C and the example of the space-floating image display device employing the optical system of FIG. 2D, the space-floating image 3 is formed in front of the transparent member 100, and the operation of the space-floating image 3 by the user's finger can be detected using the sensing light of the mid-air operation detection sensor 1351 located on the back side of the transparent member 100 as seen from the user.

[0137] The space-floating image display device employing the optical system of Fig. 2D has a different optical system from the space-floating image display device in which the optical system of Fig. 2A to Fig. 2C is arranged on the back side of the transparent member 100 as seen from the user. However, the usability of the space-floating image display device employing the optical system of Fig. 2D as seen from the user is almost the same as that of the space-floating image display device employing the optical system of Fig. 2A to Fig. 2C.

[0138] Next, Fig. 4O is a diagram showing an example of the configuration of a space-floating image display device. Fig. 4O is a diagram showing the configuration of the internal optical system of the space-floating image display device 1000 of Fig. 4N. The space-floating image display device 1000 shown in Fig. 4O is equipped with an optical system corresponding to the optical system of Fig. 2D. The space-floating image display device 1000 shown in Fig. 4O is installed horizontally so that the surface on which the space-floating image 3 is formed faces upward.

[0139] 4O, the space-floating image display device 1000 has a transparent member 100 installed on the top surface of the device. The space-floating image 3 is formed above the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels diagonally upward. If the mid-air operation detection sensor 1351 is provided as shown in the figure, it can detect the operation of the space-floating image 3 by the finger of the user 230.

[0140] Here, the configuration of Fig. 4O will be compared with the configuration of Fig. 4A to confirm the differences. In Fig. 4A, the display device 1 and the space-floating image 3 are in a plane-symmetrical relationship with respect to the plane of the polarization separation member 101. In contrast, in Fig. 4O, the display device 1 and the space-floating image 3 are in a plane-symmetrical relationship with respect to the plane of the retroreflector 5. Furthermore, the configuration of Fig. 4A includes the retroreflector 2 and the λ / 4 plate 21, but these do not exist in Fig. 4O. Furthermore, while the presence of an absorbing polarizer 12 is more preferable in Fig. 4A, the absorbing polarizer 12 is not particularly necessary in Fig. 4O.

[0141] To replace the optical system of FIG. 2A in the configuration of FIG. 4A with the optical system of FIG. 2D and to replace it with the configuration of FIG. 4O, the following can be done. That is, the polarization separation member 101 in the configuration of FIG. 4A is replaced with the retroreflector 5, and the retroreflector 2 and the λ / 4 plate 21 are removed from the configuration of FIG. 4A. The absorptive polarizer 12 is optional. By performing a replacement based on this concept, the optical system of FIGS. 2A to 2C mounted in the configuration of the space-floating image display device of FIGS. 4A to 4G can be replaced with the optical system of FIG. 2D, and the space-floating image display device can be replaced with the optical system of FIG. 2D. In this case, the polarization separation member 101 in FIGS. 4A and 4B is replaced with the retroreflector 5, and the polarization separation member 101B in FIGS. 4C to 4G is replaced with the retroreflector 5.

[0142] For example, FIG. 4P is a diagram showing an example of the configuration of a space-floating image display device. The space-floating image display device 1000 shown in FIG. 4P is equipped with an optical system corresponding to the optical system shown in FIG. 2D. FIG. 4P shows the configuration of the space-floating image display device of FIG. 4B, with the optical system shown in FIG. 2A replaced with the optical system shown in FIG. 2D. The space-floating image display device 1000 shown in FIG. 4P is installed vertically so that the surface on which the space-floating image 3 is formed faces the front of the space-floating image display device 1000 (toward the user 230). That is, in FIG. 4P, the space-floating image display device is installed with the transparent member 100 facing the front of the device (toward the user 230). The space-floating image 3 is formed on the user 230 side of the surface of the transparent member 100 of the space-floating image display device 1000. The light of the space-floating image 3 travels diagonally upward. If the mid-air operation detection sensor 1351 is installed as shown in the figure, it can detect the operation of the space-floating image 3 by the user 230's finger. 4P, the mid-air operation detection sensor 1351 can use the reflection of sensing light by the user's nail for touch detection by sensing the finger of the user 230 from above. Generally, the reflectivity of the nail is higher than that of the finger pad, so this configuration can improve the accuracy of touch detection.

[0143] According to the configuration of the space-floating image display device of FIGS. 4N to 4P, it is possible to realize a user-friendly space-floating image display device using the optical system of FIG. 2D.

[0144] <Display device> Next, the display device 1 of this embodiment will be described with reference to the drawings. The display device 1 of this embodiment includes a liquid crystal display panel 11 as an image display element 11, and a light source device 13 that constitutes a light source for the liquid crystal display panel 11. In Fig. 5, the light source device 13 is shown together with the liquid crystal display panel 11 as an exploded perspective view.

[0145] As shown by arrow 30 in Fig. 5, the image display element 11, which is a liquid crystal display panel, receives an illumination light beam from a light source device 13, which is a backlight device, that has narrow-angle diffusion characteristics, i.e., has strong directionality (in other words, linearity) and characteristics similar to laser light with a polarization plane aligned in one direction. The image display element 11, which is a liquid crystal display panel 11, modulates the received illumination light beam in accordance with an input video signal. The modulated image light is reflected by the retroreflector 2 and passes through a transparent member 100 to form a real image, a floating image (see Fig. 1).

[0146] 5, the display device 1 is configured with a light source device 13 and a liquid crystal display panel 11, a light redirection panel 54 that controls the directional characteristics of the light beam emitted from the light source device 13, and a narrow-angle diffuser (not shown) as needed. Specifically, polarizing plates are provided on both sides of the liquid crystal display panel 11, and as indicated by arrow 30 in FIG. 5, image light of a specific polarization is emitted with its intensity modulated by a video signal. This allows a desired image to be projected as highly directional (linear) light of a specific polarization via the light redirection panel 54 toward the retroreflector 2. After being reflected by the retroreflector 2, the light is transmitted toward the eyes of a monitor outside the store (space) shown in FIG. 1, forming the floating image 3. A protective cover 50 (see FIGS. 6 and 7) may be provided on the surface of the light redirection panel 54.

[0147] <Display device example 1> FIG. 6 shows an example of a specific configuration of the display device 1. In FIG. 6, a liquid crystal display panel 11 and a light direction conversion panel 54 are disposed on the light source device 13 shown in FIG. 5. This light source device 13 is configured by, for example, housing LED elements 201 and a light guide 203 inside a plastic case or the like. As shown in FIG. 5 and other figures, the end surface of the light guide 203 is provided with a lens shape whose cross-sectional area gradually increases toward the light receiving section in order to convert divergent light from each LED element 201 into a substantially parallel beam. The lens shape has an effect of gradually reducing the divergence angle by multiple total reflections during propagation inside. The liquid crystal display panel 11 constituting the display device 1 is attached to the top surface of the display device 1. In addition, an LED substrate 202 mounting the LED elements 201, which are semiconductor light sources, and their control circuits is attached to one side surface of the light source device 13 (the left end surface in this example). A heat sink, which is a member for cooling the heat generated by the LED elements 201 and the control circuit, may be attached to the outer surface of the LED substrate 202.

[0148] The liquid crystal display panel 11 is mounted on the top surface of the case of the light source device 13 through a frame (not shown) for the liquid crystal display panel 11. The frame is also fitted with an FPC (Flexible Printed Circuits) (not shown) electrically connected to the liquid crystal display panel 11. The liquid crystal display panel 11, which is the image display element 11, generates a display image by modulating the intensity of transmitted light in conjunction with the LED elements 201, which are solid-state light sources, based on a control signal from a control circuit (image control unit 1160 in FIG. 3) constituting the electronic device. The generated image light has a narrow diffusion angle and contains only specific polarization components, resulting in a novel image display device similar to a surface-emitting laser image source driven by a video signal. Currently, it is technically and safety-wise impossible to obtain a laser beam of the same size as the image obtained by the display device 1 described above using a laser device. Therefore, in this embodiment, light similar to the surface-emitting laser image light described above is obtained from a beam of light from a general light source, such as an LED element.

[0149] Next, the configuration of the optical system housed in the case of light source device 13 will be described in detail with reference to Fig. 6 and Fig. 7. Because Fig. 6 and Fig. 7 are cross-sectional views, only one of the multiple LED elements 201 constituting the light source is shown, and this is converted into approximately parallel light (collimated light) by the shape of light-receiving end surface 203a of light guide 203. For this reason, the light-receiving portion of the light guide end surface and LED element 201 are attached while maintaining a predetermined positional relationship.

[0150] Each light guide 203 is formed of a translucent resin such as acrylic. The LED light receiving surface at the end of light guide 203 has a cone-shaped outer periphery obtained by rotating a parabolic cross section, and the top of the light guide 203 has a concave portion with a convex portion (i.e., a convex lens surface) formed in the center, and the center of the flat portion has a convex lens surface (or a concave lens surface) that protrudes outward (not shown). The outer shape of the light receiving portion of the light guide to which LED element 201 is attached is a parabolic shape that forms a cone-shaped outer periphery, and is set within an angle range that allows total reflection within the light that is emitted from the LED element toward the periphery, or a reflective surface is formed.

[0151] On the other hand, the LED elements 201 are arranged at predetermined positions on the surface of the circuit board, that is, the LED substrate 202. The LED substrate 202 is arranged and fixed so that the LED elements 201 on the surface are positioned in the center of the recessed portion described above with respect to the light-receiving end surface 203a, that is, the LED collimator.

[0152] According to this configuration, the shape of the light-receiving end surface 203a of the light guide 203 makes it possible to extract the light emitted from the LED element 201 as approximately parallel light, thereby improving the efficiency of use of the generated light.

[0153] As described above, the light source device 13 is configured by attaching a light source unit having a plurality of LED elements 201 arranged as light sources to the light-receiving end surface 203a, which is a light-receiving section provided on the end surface of the light guide 203, and the divergent light beams from the LED elements 201 are converted into approximately parallel light by the lens shape of the light-receiving end surface 203a of the light guide 203, which is guided inside the light guide 203 as shown by the arrow, and emitted by the light beam direction conversion means 204 towards the liquid crystal display panel 11, which is arranged approximately parallel to the light guide 203. By optimizing the distribution (in other words, density) of the light beam direction conversion means 204 depending on the shape of the inside or surface of the light guide 203, it is possible to control the uniformity of the light beam incident on the liquid crystal display panel 11.

[0154] The light beam direction conversion means 204 described above emits the light beam propagated inside the light guide 203 toward the liquid crystal display panel 11 disposed approximately parallel to the light guide 203, by using the shape of the surface of the light guide 203 or by providing a portion with a different refractive index inside the light guide 203. At this time, when the liquid crystal display panel 11 is faced directly at the center of the screen and the viewpoint is positioned at the same position as the diagonal dimension of the screen, if the relative brightness ratio between the center of the screen and the periphery of the screen is 20% or more, there is no practical problem, and if it exceeds 30%, it will be an even better characteristic.

[0155] 6 is a cross-sectional layout diagram illustrating the configuration and operation of a light source of this embodiment that performs polarization conversion in light source device 13 including light guide 203 and LED element 201 described above. In Fig. 6, light source device 13 is composed of light guide 203 formed of, for example, plastic or the like and having light beam direction conversion means 204 on its surface or inside, LED element 201 as a light source, reflective sheet 205, retardation plate 206, lenticular lens, etc. Attached to the top surface of light source device 13 is liquid crystal display panel 11 that has polarizing plates on the light source light entrance surface and the image light exit surface.

[0156] Furthermore, a film- or sheet-like reflective polarizing plate 49 is provided on the light source light incidence surface (the lower surface in the figure) of the liquid crystal display panel 11 corresponding to the light source device 13, and selectively reflects one polarized wave (e.g., P wave) 212 of the natural light beam 210 emitted from the LED element 201. The reflected light is reflected again by a reflective sheet 205 provided on one surface (the lower surface in the figure) of the light guide 203, and directed toward the liquid crystal display panel 11. Therefore, a retardation plate (λ / 4 plate) is provided between the reflective sheet 205 and the light guide 203 or between the light guide 203 and the reflective polarizing plate 49. The reflected light (reflected light beam) is reflected by the reflective sheet 205 and passes through the retardation plate (λ / 4 plate) twice, thereby converting it from P polarized light to S polarized light. This improves the utilization efficiency of the light source light as image light. The image light beam, the light intensity of which has been modulated by the image signal in the liquid crystal display panel 11, is emitted as shown by the arrow 213 in Fig. 6 and enters the retroreflector 2. After reflection by the retroreflector 2, a real image, a floating image in space, can be obtained.

[0157] 7 is a cross-sectional layout diagram illustrating the configuration and operation of a light source of this embodiment that performs polarization conversion in light source device 13 including light guide 203 and LED elements 201, similar to Fig. 6. Light source device 13 is similarly composed of light guide 203 formed of, for example, plastic and having light beam direction conversion means 204 on its surface or inside, LED elements 201 as a light source, reflective sheet 205, retardation plate 206, lenticular lens, etc. Attached to the top surface of light source device 13 is liquid crystal display panel 11 that has polarizing plates on the light source light entrance surface and the image light exit surface.

[0158] A film- or sheet-like reflective polarizing plate 49 is provided on the light source light incidence surface (the lower surface in the figure) of the liquid crystal display panel 11 corresponding to the light source device 13, and selectively reflects one polarized wave (e.g., S wave) 211 of the natural light beam 210 emitted from the LED element 201. That is, in the example of FIG. 7, the selective reflection characteristics of the reflective polarizing plate 49 are different from those in FIG. 7. The reflected light is reflected by a reflective sheet 205 provided on one surface (the lower surface in the figure) of the light guide 203 and returns to the liquid crystal display panel 11. A retardation plate (λ / 4 plate) is provided between the reflective sheet 205 and the light guide 203 or between the light guide 203 and the reflective polarizing plate 49. The reflected light (reflected light beam) is reflected by the reflective sheet 205 and passes through the retardation plate (λ / 4 plate) twice, converting it from S-polarized light to P-polarized light. This improves the utilization efficiency of the light source light as image light. The image light beam, which has been intensity-modulated by the image signal on the liquid crystal display panel 11, is emitted as shown by the arrow 214 in Fig. 7 and enters the retroreflector 2. After being reflected by the retroreflector 2, a real image, a floating image in space, can be obtained.

[0159] In the light source device 13 shown in Figures 6 and 7, in addition to the function of the polarizer provided on the light incident surface of the corresponding liquid crystal display panel 11, a reflective polarizer reflects the polarized light component on one side. Therefore, the theoretically obtainable contrast ratio is the reciprocal of the cross transmittance of the reflective polarizer multiplied by the reciprocal of the cross transmittance obtained by the two polarizers attached to the liquid crystal display panel 11. This results in high contrast performance. In fact, experiments have confirmed that the contrast performance of the displayed image is improved by more than 10 times. As a result, high-quality images comparable to those of self-luminous organic EL devices are obtained.

[0160] <Display device example 2> 8 shows another example of the specific configuration of the display device 1. The light source device 13 of this display device 1 is configured by housing LEDs, a collimator, a composite diffusion block, a light guide, etc. in a case made of, for example, plastic, and a liquid crystal display panel 11 is attached to the upper surface of the light source device 13. Also, LED elements 201, which are semiconductor light sources, and an LED board 202, on which a control circuit for the LED elements 201 is mounted, are attached to one side of the case of the light source device 13, and a heat sink 103, which is a member for cooling heat generated by the LED elements 201 and the control circuit, is attached to the outer surface of the LED board 202.

[0161] The liquid crystal display panel frame attached to the top surface of the case of the light source device 13 is configured to have attached thereto the liquid crystal display panel 11 attached to the frame, and further to have attached thereto an FPC 403 electrically connected to the liquid crystal display panel 11. That is, the liquid crystal display panel 11, which is the image display element 11, generates a display image together with the LED elements 201, which are solid-state light sources, by modulating the intensity of transmitted light based on a control signal from a control circuit (not shown) that constitutes the electronic device.

[0162] <Display device example 3> Next, another example of the specific configuration of the display device 1 (Example 3 of the display device) will be described with reference to Fig. 9. The light source device of this display device 1 converts a divergent beam of light (a mixture of P-polarized and S-polarized light) from the LED 201 into a substantially parallel beam by a collimator (LED collimator) 18, and reflects the parallel beam toward the liquid crystal display panel 11 by the reflecting surface of the reflective light guide 304. The reflected light is incident on a reflective polarizer 49 disposed between the liquid crystal display panel 11 and the reflective light guide 304. The reflective polarizer 49 transmits light of a specific polarization (e.g., P-polarized light) and causes the transmitted polarized light to be incident on the liquid crystal display panel 11. Here, light of polarization other than the specific polarization (e.g., S-polarized light) is reflected by the reflective polarizer 49 and directed toward the reflective light guide 304 again.

[0163] The reflective polarizing plate 49 is installed at an angle with respect to the liquid crystal display panel 11 so that the reflective polarizing plate 49 is not perpendicular to the chief ray of light from the reflective surface of the reflective light guide 304. The chief ray of the light reflected by the reflective polarizing plate 49 is incident on the transmission surface of the reflective light guide 304. The light that has entered the transmission surface of the reflective light guide 304 passes through the back surface of the reflective light guide 304, passes through the λ / 4 plate 270 which is a retardation plate, and is reflected by the reflector 271. The light reflected by the reflector 271 passes through the λ / 4 plate 270 again, and passes through the transmission surface of the reflective light guide 304. The light that has passed through the transmission surface of the reflective light guide 304 is incident on the reflective polarizing plate 49 again.

[0164] At this time, the light that re-enters the reflective polarizer 49 has passed through the λ / 4 plate 270 twice, and therefore its polarization has been converted to a polarization (for example, P-polarized light) that is transmitted through the reflective polarizer 49. Therefore, the light whose polarization has been converted passes through the reflective polarizer 49 and enters the liquid crystal display panel 11. Note that with regard to the polarization design related to the polarization conversion, the polarization may be configured in reverse from the above explanation (S-polarized light and P-polarized light may be reversed).

[0165] As a result, the light from the LED 201 is aligned to a specific polarization (for example, P polarization), enters the liquid crystal display panel 11, and is brightness-modulated in accordance with the video signal to display an image on the panel surface. As in the above example, there are multiple LEDs 201 that constitute the light source, and these are attached to predetermined positions relative to the corresponding collimators 18 of the multiple collimators 18. However, since Figure 9 is a vertical cross section, only one LED 201 and one collimator 18 are shown.

[0166] Each of the collimators 18 is formed of, for example, a translucent resin such as acrylic or glass. The collimator 18 may have a cone-shaped outer peripheral surface obtained by rotating a parabolic cross section. The collimator 18 may have a concave portion with a convex portion (i.e., a convex lens surface) formed in the center of the apex (the side facing the LED substrate 202) of the collimator 18. The collimator 18 may have a convex lens surface protruding outward (or a concave lens surface recessed inward) in the center of the flat portion (the side opposite the apex). The parabolic surface forming the cone-shaped outer peripheral surface of the collimator 18 is set within an angle range that allows the light emitted from the LED 201 in the peripheral direction to be totally reflected therein, or a reflective surface is formed therein.

[0167] The LEDs 201 are arranged at predetermined positions on the surface of the LED substrate 202, which is the circuit board. The LED substrate 202 is arranged and fixed to the collimator 18 so that the LEDs 201 on the surface are positioned at the center of the apex of the conical convex shape (or in the concave portion if the apex has a concave portion).

[0168] With this configuration, the collimator 18 focuses the light emitted from the LED 201, particularly the light emitted from the central portion, into parallel light by the convex lens surface that forms the outer shape of the collimator 18. Light emitted from other portions toward the periphery is reflected by the parabolic surface that forms the outer peripheral surface of the cone shape of the collimator 18, and is similarly focused into parallel light. In other words, the collimator 18, which has a convex lens in its center and a parabolic surface formed on its periphery, makes it possible to extract almost all of the light generated by the LED 201 as parallel light, thereby improving the utilization efficiency of the generated light.

[0169] Furthermore, the light converted into approximately parallel light by the collimator 18 shown in FIG. 9 is reflected by the reflective light guide 304. Due to the action of the reflective polarizer 49, light of a specific polarization of the light is transmitted through the reflective polarizer 49, while light of the other polarization reflected by the reflective polarizer 49 is transmitted again through the light guide 304. The light is reflected by the reflector 271, which is located opposite the liquid crystal display panel 11 with respect to the reflective light guide 304. At this time, the light is polarized and converted twice by passing through the λ / 4 plate 270, which is a retardation plate. The light reflected by the reflector 271 is transmitted again through the light guide 304 and enters the reflective polarizer 49 provided on the opposite surface. Since the incident light has been polarization-converted, it is transmitted through the reflective polarizer 49 and enters the liquid crystal display panel 11 with its polarization direction aligned. As a result, all of the light from the light source can be utilized, thereby doubling the geometrical optical utilization efficiency of light. Furthermore, since the degree of polarization (extinction ratio) of the reflective polarizer 49 is also included in the extinction ratio of the entire system, the use of the light source device of this embodiment significantly improves the contrast ratio of the entire display device. Note that the reflection diffusion angle of light at each reflective surface can be adjusted by adjusting the surface roughness of the reflective surface of the reflective light guide 304 and the surface roughness of the reflector 271. The surface roughness of the reflective surface of the reflective light guide 304 and the surface roughness of the reflector 271 can be adjusted for each design to optimize the uniformity of the light incident on the liquid crystal display panel 11.

[0170] It should be noted that the λ / 4 plate 270, which is the retardation plate in Fig. 9, does not necessarily have to have a phase difference of λ / 4 with respect to polarized light that is perpendicularly incident on the λ / 4 plate 270. In the configuration of Fig. 9, any retardation plate may be used as long as the phase changes by 90° (λ / 2) when polarized light passes through it twice. The thickness of the retardation plate may be adjusted according to the incident angle distribution of the polarized light.

[0171] <Display device example 4> Furthermore, another example (display device example 4) of the configuration of the optical system such as the light source device of display device 1 will be described with reference to FIG. 10 . Display device example 4 is a configuration example in which a diffusion sheet is used instead of reflective light guide 304 in the light source device of display device example 3. Specifically, two optical sheets (in other words, diffusion sheets) that convert the diffusion characteristics in the vertical and horizontal directions of the drawing (front and back directions in the drawing, not shown) are used on the light emission side of collimator 18. The two optical sheets are shown as optical sheet 207A and optical sheet 207B. Light from collimator 18 is made to enter between the two optical sheets.

[0172] The optical sheet may be a single sheet instead of a two-sheet configuration. In the case of a single sheet configuration, the vertical and horizontal diffusion characteristics are adjusted by the fine shapes on the front and back surfaces of the single optical sheet. Alternatively, multiple diffusion sheets may be used to share the functions. In the example of FIG. 10 , the reflection and diffusion characteristics due to the front and back shapes of optical sheets 207A and 207B can be optimally designed using the number of LEDs 201, the divergence angle from LED substrate 202, and the optical specifications of collimator 18 as design parameters so that the surface density of the light beam emitted from liquid crystal display panel 11 is uniform. In other words, in the example of FIG. 10 , the diffusion characteristics are adjusted by the surface shapes of multiple diffusion sheets instead of light guides.

[0173] In the example of FIG. 10, polarization conversion is performed in the same manner as in the display device example 3 described above. That is, in the example of FIG. 10, reflective polarizing plate 49 may be configured to have the property of reflecting S-polarized light (transmitting P-polarized light). In this case, the reflective polarizing plate 49 transmits P-polarized light out of the light emitted from LED 201, which is the light source, and the transmitted light enters liquid crystal display panel 11. The reflective polarizing plate 49 reflects S-polarized light out of the light emitted from LED 201, which is the light source, and the reflected light passes through retardation plate 270 shown in FIG. 10. The light that passes through retardation plate 270 is reflected by reflector 271. The light reflected by reflector 271 passes through retardation plate 270 again and is converted to P-polarized light. The polarization-converted light passes through reflective polarizing plate 49 and enters liquid crystal display panel 11.

[0174] It should be noted that the λ / 4 plate 270, which is the retarder in FIG. 10, does not necessarily have to have a phase difference of λ / 4 with respect to polarized light that is perpendicularly incident on the λ / 4 plate 270. In the configuration of FIG. 10, any retarder that changes the phase by 90° (λ / 2) when polarized light passes through it twice will suffice. The thickness of the retarder may be adjusted according to the distribution of incident angles of the polarized light. It should be noted that in FIG. 10 as well, the polarization design for polarization conversion may be configured in reverse (reversing the S-polarized light and P-polarized light) from the above explanation.

[0175] In a typical TV device, the light emitted from the LCD panel 11 has similar diffusion characteristics in both the horizontal direction of the screen (shown by the X-axis in FIG. 12(a)) and the vertical direction of the screen (shown by the Y-axis in FIG. 12(b)). In contrast, the diffusion characteristics of the light beam emitted from the LCD panel 11 of this embodiment are 1 / 5 of the 62-degree viewing angle of a typical TV device, as shown in Example 1 of FIG. 12, when the viewing angle at which the luminance is 50% of that at a front view (angle of 0 degrees) is set to 13 degrees. Similarly, the vertical viewing angle is asymmetric between the top and bottom, and the reflection angle and the area of ​​the reflective surface of the reflective light guide are optimized to keep the upper viewing angle to about 1 / 3 of the lower viewing angle. As a result, the amount of image light directed toward the monitoring direction is significantly improved compared to conventional LCD TVs, with brightness being more than 50 times higher.

[0176] Furthermore, assuming the viewing angle characteristics shown in Example 2 in Figure 12, if the viewing angle at which brightness is 50% of that when viewed from the front (angle of 0 degrees) is set to 5 degrees, this will be 1 / 12 of the 62 degrees of devices used for general TV applications. Similarly, the vertical viewing angle is optimized by optimizing the reflection angle and the area of ​​the reflective surface of the reflective light guide so that the viewing angle is approximately 1 / 12 of that of devices used for general TV applications, with equal viewing angle both above and below. As a result, the amount of image light directed in the monitoring direction is significantly improved compared to conventional LCD TVs, and brightness is more than 100 times greater.

[0177] As described above, by setting the viewing angle to a narrow angle, the amount of luminous flux directed in the monitoring direction can be concentrated, significantly improving the efficiency of light utilization. As a result, even when using a liquid crystal display panel for general TV applications, by controlling the light diffusion characteristics of the light source device, it is possible to achieve a significant improvement in brightness with similar power consumption, making it possible to create a video display device that is compatible with information display systems facing bright outdoor environments.

[0178] When using a large LCD display panel, the overall brightness of the screen can be improved by directing the light from the periphery of the screen inward so that it is directed toward the observer when the observer is facing the center of the screen. Figure 11 shows the convergence angle between the long and short sides of the panel when the observer's distance from the panel, L, and the panel size (screen ratio 16:10) are used as parameters. When monitoring with the screen in portrait orientation, the convergence angle can be set to match the short side. For example, when using a 22-inch panel in portrait orientation and the monitoring distance is 0.8 m, a convergence angle of 10 degrees will allow the image light from the four corners of the screen to be effectively directed toward the observer.

[0179] Similarly, when monitoring with a 15-inch panel in portrait orientation, if the monitoring distance is 0.8 m, a convergence angle of 7 degrees will allow the image light from the four corners of the screen to be effectively directed towards the monitor. As mentioned above, depending on the size of the LCD panel and whether it is used portrait or landscape, the overall brightness of the screen can be improved by directing the image light from the periphery of the screen towards the monitor who is in the optimum position to monitor the centre of the screen.

[0180] As shown in Figure 9, the basic configuration involves a light source device directing a light beam with a narrow angle of directionality to a liquid crystal display panel 11, which is then luminance-modulated according to a video signal. The video information displayed on the screen of the liquid crystal display panel 11 is then reflected by a retroreflector, and the resulting floating image is displayed indoors or outdoors via a transparent member 100.

[0181] By using the display device and light source device according to the embodiment of the present invention described above, it is possible to realize a space floating image display device with higher light utilization efficiency.

[0182] <Example 2> As the second embodiment of the present invention, a configuration example of a space floating image display device will be described. The space floating image display device according to this embodiment can be applied with the configurations of each figure explained in the first embodiment as a basic configuration. In this embodiment, differences from the first embodiment will be mainly explained, and repeated explanations of the same configuration as the first embodiment will be omitted.

[0183] [Problem of Example 2] FIG. 13 is an explanatory diagram relating to the problem of Example 2. A space-floating image display device 1000 of the comparative example of FIG. 13 is installed in a store or the like, and displays a space-floating image 3. Assume that a user 230 is at a position (e.g., position Y2) some distance in the front-to-back direction (the Y direction in the figure) from the space-floating image display device 1000 of the comparative example and the space-floating image 3. In this way, when the user 230 is not near the device, the space-floating image 3 cannot be seen from the position 1304 (e.g., position Y2) of the user 230's viewpoint 232, so it is difficult for the user 230 to notice the presence of the space-floating image 3 (and the space-floating image display device 1000).

[0184] In the illustrated example, the preferred viewable position (in other words, the reference observation position) of the floating in space image 3 is viewing position 1302, which is located at the end of the emission direction 1301 of image light a1 that forms the floating in space image 3, and is position Y1 in the Y direction. When the position of the viewpoint 232 of user 230 is within a predetermined allowable range 1303 (in other words, a viewing angle range, a reference range, etc.) centered on this viewing position 1302, user 230 can preferably view the floating in space image 3. From such viewing position 1302, user 230 can preferably view the floating in space image 3 in direction A1 indicated by the arrow (for example, at a depression angle of about 45 degrees diagonally downward).

[0185] Therefore, this embodiment has a configuration for informing the user 230 of the existence of the space-floating image 3 and guiding the user 230 to the suitable viewing position 1302 (allowable range 1303) of the space-floating image 3 even when the user 230 is not near the device, in other words, when the user is not in the suitable viewing position 1302 (allowable range 1303) of the space-floating image 3. In this embodiment 2, a graphic design display (1500 in FIGS. 14 and 15) corresponding to a user interface for informing the user 230 of the existence of the space-floating image 3 and guiding the user 230 to the suitable viewing position 1302 of the space-floating image 3 is provided on the transparent member 100, which is the top surface of the housing 1190.

[0186] This graphic design display 1500 is realized by transparent portions 1901 and non-transparent portions 1902 of the design layer 1400, which will be described later (FIGS. 16, 17, etc.). This graphic design display 1500 is a visible light display that is visible / easy to see even when the user 230 is not near the device. By looking at this graphic design display 1500, the user 230 is guided to a particularly suitable viewing position 1302 (position Y1) near the device, and can view the floating image 3 in a suitable manner from that viewing position 1302.

[0187] Furthermore, in this second embodiment, the graphic design display 1500 can be turned on / off as needed. For example, when guidance for the user 230 is not necessary (for example, when the user 230 is near the device, etc.), the space floating image display device 1000 turns off the graphic design display 1500, and when guidance for the user 230 is necessary (for example, when the user 230 is not near the device, etc.), it turns on the graphic design display 1500. When the graphic design display 1500 is in the off state, the graphic design blends into the pattern of the decorative layer 1401 (FIG. 16, etc.) and becomes inconspicuous.

[0188] [Embodiment 2: Space-Floating Image Display Device] FIG. 14 shows a configuration example of a space-floating image display device 1000 according to a second embodiment. Similar to FIG. 13, FIG. 14 shows a YZ plane view of the device and the user 230 viewed from the side. A major feature of the second embodiment is the design layer 1400, which includes a decorative layer 1401 and is located below (or above) the transparent member 100. The decorative layer 1401 is a layer that realizes a predetermined decorative display, such as a wood grain or marble finish. The design layer 1400 (in other words, a graphic design layer) is a layer that realizes a predetermined graphic design display 1500 (see FIG. 15, etc.) corresponding to a user interface that guides the user 230, based on the predetermined decoration provided by the decorative layer 1401. The graphic design display 1500 is, in other words, illumination, etc. The graphic design display 1500 is configured to be visible to the user 230 even from a certain distance away. The user 230 can view the graphic design display 1500 from, for example, the viewpoint position 1304 (position Y2) (viewing direction 1306).

[0189] Although the transparent member 100 and the design layer 1400 are shown as separate layers, they may be implemented as an integrated layer. The transparent member 100 and the design layer 1400 may be collectively referred to as a light-transmitting member.

[0190] 13 and 14, the housing 1190 is of a horizontally placed type, and is based on the optical system of FIG. 2A. Image light a1 that forms the floating-in-space image 3 is emitted from an image light emitting portion (in other words, an opening) 100A of a transparent member 100 or the like, obliquely upward (at an angle θ, approximately 45 degrees in this example) to the outside. The emitted image light a1 forms the floating-in-space image 3 (corresponding display range 3R, screen) that is a real image at a predetermined position 1305. In this example, the floating-in-space image 3 formed at position 1305 has an obliquely inclined plane (the xy plane shown in the figure).

[0191] The aerial operation detection sensor 1351 is arranged, for example, on the front side of the top surface of the housing 1190 so that its detection axis (shown by a dashed dotted line) covers the plane of the floating-in-space image 3 (corresponding display range 3R). The aerial operation detection sensor 1351 is not limited to this, and it may be arranged in any way as long as it can cover the detection of the plane of the floating-in-space image 3. The aerial operation detection sensor 1351 can detect an aerial operation performed by the fingers of the user 230 on the floating-in-space image 3.

[0192] Furthermore, the camera of the imaging unit 1180 may be disposed in the housing 1190. For example, the camera of the imaging unit 1180 shown in the figure is disposed at the back of the top surface of the housing 1190. This camera can capture the area ahead in the Y direction and capture the floating in space image 3 and the user 230 in front of the device. A sensor such as this camera (which may be a stereo camera or a distance measuring sensor) may be used to detect whether the user 230 has approached or moved away from the device and the floating in space image 3, or may measure the distance of approach. Similarly, a human presence sensor (for example, an infrared sensor) may be provided on the front of the device. A sensor such as this camera may detect an aerial operation with a finger on the floating in space image 3, or may capture the face of the user 230 to perform face authentication.

[0193] [Design Layer Graphic Design] 15 shows an XY plan view of the transparent member 100 and the surface of the design layer 1400, which are the upper surface of the housing 1190 of the space-floating image display device 1000 of FIG. 14, viewed from above in the Z direction. In this second embodiment, a graphic design display 1500 by the design layer 1400 is displayed with visible light, allowing the user 230 to recognize the graphic design display 1500 (corresponding user interface, guidance information). Depending on the shapes of the transparent portion 1901 and non-transparent portion 1902 (FIG. 17, etc.) described below, the graphic design display 1500 can be realized in any shape, including characters and figures.

[0194] Area A (area indicated by a diagonal line pattern) is a rectangular area on the top surface of the housing 1190 that corresponds to the rectangular image light emitting section 100A from which image light a1 that forms the space floating image 3 is emitted to the outside. Area A transmits image light a1, sensor light, etc. The image light emitting section 100A in area A does not have a design layer 1400 (transmissive section 1901, non-transmissive section 1902, etc., described below) formed therein.

[0195] Area B is the area of ​​the top surface excluding image light output section 100A, and is where design layer 1400 (transmissive section 1901, non-transmissive section 1902, etc., described below) is formed. The gray area of ​​area B is where non-transmissive section 1902, described below, is located, and is an area that does not transmit visible light based on side light source 1600. The white area of ​​area B (particularly area D) corresponds to graphic design display 1500 (1500A, 1500B, 1500C), and is where transmissive section 1901, described below, etc., is located, and is an area that transmits visible light based on side light source 1600.

[0196] Area C (shown in white) between areas A and B is the frame of image light output unit 100A. Design layer 1400 (transparent area 1901, etc., described below) is formed in area C, and is designated as graphic design display 1500D.

[0197] Regions B (particularly region D) and C of the top surface have a predetermined graphic design (in other words, a graphic design display) 1500 formed by the design layer 1400. In this second embodiment, a predetermined region D on the top surface, which is on the front side in the Y direction (the front side of the image light output unit 100A), has a predetermined graphic design display 1500 (1500A, 1500B, 1500C). In this example, the graphic design display 1500 includes multiple examples, such as graphic design display 1500A, graphic design display 1500B, and graphic design display 1500C. It is sufficient to have at least one graphic design display. In this example, the frame portion (region C) of the opening 100A is also configured as graphic design display 1500D.

[0198] These graphic design displays 1500 are all displays for guiding the user 230 to the existence of the floating image 3 in space and the preferred viewing position 1302. In other words, the graphic design displays 1500 are user interface displays, guidance displays, guide displays, etc. The graphic design displays 1500 may be configured with icons, marks, etc.

[0199] Areas A and B, where the decorative layer 1401 (FIG. 16) is located, are both areas where the pattern created by the decorative layer 1401 is visible, and appear to be roughly the same brightness. In contrast, the graphic design displays 1500 (white areas) appear brighter. When the side light source 1600 is off, the graphic design displays 1500 become dark, and the pattern created by the decorative layer 1401 is visible across the entire surface.

[0200] An example of graphic design display 1500A is a display that includes a handprint and the word "Touch!" as an icon, and is a display that guides user 230 to place / touch the handprint. In this example, graphic design display 1500A of the handprint is positioned on the right hand side in the X direction with respect to the front of the device, but it may also be positioned on the left hand side or near the center.

[0201] Furthermore, the graphic design display 1500A etc. may be made to blink by controlling the on / off blinking of the side light source 1600. This makes the graphic design display 1500A etc. more easily recognizable to the user 230.

[0202] In the example of graphic design display 1500A, when user 230 places his / her hand on / touches this handprint, the position and posture of user 230's head will be near viewing position 1302 (tolerance range 1303) in front of the device as shown. Therefore, graphic design display 1500A can guide user 230 to a suitable viewing position 1302. In addition, the state in which the hand is placed on / touching the handprint in graphic design display 1500A can be detected (described below), and in response to the detection, control such as displaying floating image 3 in space may be performed. Furthermore, at the same time as displaying floating image 3 in space, control such as turning off graphic design display 1500A may be performed.

[0203] An example of graphic design display 1500B has three lines of different lengths pointing toward the front edge of the frame of image light output unit 100A, and is a display that guides user 230 to face this front edge. Also, by controlling the local dimming of side light source 1600 (described later), it is possible to control the three lines to light up sequentially, for example.

[0204] Another example of the graphic design display 1500B may be a graphic design display 1500E in the shape of an arrow pointing toward the front side of the image light output unit 100A, as shown at the bottom.

[0205] An example of graphic design display 1500C has an image representing a floating image 3 (screen) floating in the air at an angle above the top surface of the device and the word "Float Image," and is a display that conveys the existence of a floating image 3 (screen) floating in the air at an angle above the top surface of the device.

[0206] An example of graphic design display 1500D is to make opening 100A glow conspicuously in a frame shape, thereby informing user 230 that there is a floating image 3 (corresponding image light emitting section 100A) corresponding to this frame.

[0207] Light source (in other words, side light source) 1600 is a light source for realizing graphic design display 1500, and is illustrated schematically as a light source arranged in a side direction (X and Y directions, particularly the -Y direction in this example, on the front side, in front of the device) relative to design layer 1400 and housing 1190. Side light source 1600 is mounted on housing 1190. Graphic design display 1500 is realized by light (visible light) guided from side light source 1600 in a planar direction (X and Y directions, particularly the +Y direction in this example) and emitted in the Z direction from side light source 1600.

[0208] 15, graphic design display 1500 (1500A, 1500B, 1500C) is provided mainly in area 1510 on the near side in the Y direction, and correspondingly, side light source 1600 is provided along the X direction on the side surface on the near side in the Y direction. Because the distance from side light source 1600 to area 1510 in the Y direction is short, light can be guided efficiently in the Y direction, making it possible to brighten graphic design display 1500 in area 1510. The position of side light source 1600 is not limited to this.

[0209] Area 1351a shows an example of the arrangement of the area of ​​the detection light incident / emitting surface of aerial operation detection sensor 1351 corresponding to FIG. 14. Area 1351a of aerial operation detection sensor 1351 may be arranged anywhere on the top surface of housing 1190. It is particularly desirable that area 1351a of aerial operation detection sensor 1351 be arranged separately from the area of ​​graphic design display 1500. In this example, area 1351a is arranged separately from the area of ​​graphic design display 1500B on the top surface of housing 1190, in an area closer to the front side in the Y direction and on the front side of the device. In other words, graphic design display 1500B is provided in an area that does not overlap with area 1351a.

[0210] [Design Layer (1)] 16 is a YZ plan view of the AA cross section (near the center in the X direction) of FIG. 15 in the housing 1190 of the space-floating image display device 1000 of FIG. 14. In FIG. 16, the optical system that forms the space-floating image 3 is based on FIG. 2A, but it is not limited to this and can also be based on the optical system of FIG. 2D. The design layer 1400 is a layer on which transparent portions 1901 and non-transparent portions 1902 (FIG. 17, etc.) are provided according to the graphic design display 1500 such as areas C and D (white areas) in FIG. 15. Details of the design layer 1400 will be shown in FIG. 17, etc., which will be described later.

[0211] 14 and other figures, the design layer 1400 is positioned below the bottom edge of the spatial floating image 3 in the Z direction. The design layer 1400 is positioned above or below the transparent member 100. Note that although the transparent member 100 and the design layer 1400 are separate layers, this is not limiting, and the transparent member 100 and the design layer 1400 may be configured as an integrated layer.

[0212] 16 shows a configuration example in which the design layer 1400 is formed above the beam splitter 101 and the transparent member 100 in the Z direction. However, the present invention is not limited to this, and a configuration example in which the design layer 1400 is formed below the transparent member 100 in the Z direction is also possible. In other words, the transparent member 100 is a protective glass plate.

[0213] 16, a decorative layer 1401 is provided over the entire top surface of the housing 1190, including the image light emitting unit 100A. In other words, the decorative layer 1401 is a decorative print layer, which is a layer that realizes a predetermined decoration such as a wood grain or marble finish. The decorative layer 1401 transmits the image light a1 that forms the spatial floating image 3. However, in a modified example, the decorative layer 1401 may be provided on only a part of the top surface of the housing 1190.

[0214] 21, the image light emitting unit 100A (areas A and C) is not provided with a decorative layer 1401, and instead is provided with a transparent member 1401B. Neither the diffuse reflecting member 1801 nor the transmissive portion 1901 is provided in area C of the frame of the image light emitting unit 100A.

[0215] 16, the aerial operation detection sensor 1351 is not shown, but in reality, there is an area 1351a for the aerial operation detection sensor 1351 as shown in Fig. 15. Fig. 19, which will be described later, shows an example of the arrangement of the aerial operation detection sensor 1351.

[0216] [Design layer (2)] Figure 17 shows an enlarged view of the design layer 1400 and other components of Figure 16. In particular, it shows a cross-sectional view taken along line AA near the area 1510 where the graphic design display 1500B on the top surface of Figure 15 is arranged. The design layer 1400 is arranged above the beam splitter 101 and the transparent member 100. The design layer 1400 has, from bottom to top in the Z direction, a first layer, a diffuse reflection layer (or air layer) 1701; a second layer, a transparent substrate layer (or light guide layer) 1702; a third layer, a transmissive / non-transmissive layer 1703 (or a design layer in the narrow sense); and a fourth layer, a decorative layer 1401.

[0217] The first layer, diffuse reflection layer (air layer) 1701, is a layer based on the air between transparent member 100 and transparent base material layer 1702, and in the X and Y directions, diffuse reflection members 1801 are disposed in contact with transparent base material layer 1702 at positions corresponding to the respective transmission sections 1901. Furthermore, spacers 1802 are provided at predetermined positions in the X and Y directions to connect transparent member 100 and transparent base material layer 1702 and form a predetermined thickness.

[0218] The diffuse reflection member 1801 is a member that has the property of diffusing and reflecting light from the side light source 1600, and is implemented with, for example, reflective dot printing, white printing, fine patterns, etc. The diffuse reflection member 1801 is not provided in the opening 100A.

[0219] In this embodiment, an air gap is provided in the diffuse reflection layer 1701 between the transparent member 100 and the transparent base material layer 1702. This is to increase the efficiency of light guide by totally reflecting light at the interface between the transparent base material layer 1702 and the air (FIG. 18 described below).

[0220] However, in a modified example, a transparent substrate may be filled in the air portion of the diffuse reflective layer 1701. In another modified example, the width of the diffuse reflective member 1801 may be wider than the width of the transmissive portion 1901. Alternatively, the diffuse reflective member 1801 may be formed all over in one direction. Furthermore, a reflective layer (a member similar to the reflective layer 1903) may be provided in an area other than the diffuse reflective member 1801 on the surface of the diffuse reflective layer 1701 that contacts the transparent substrate layer 1702.

[0221] In a modified example, an anti-reflection film (e.g., a dielectric multilayer film or a moth-eye film) may be provided on the surface of the diffuse reflection layer 1701 that contacts the transparent member 100. When light that is not totally reflected within the transparent base material layer 1702 enters the diffuse reflection layer 1701, it may be multiple-reflected between the transparent base material layer 1702 and the transparent member 100, resulting in stray light. The anti-reflection film can prevent this stray light. The use of a moth-eye film is preferable because it has low dependency on the angle of incidence.

[0222] Spacers 1802 are provided at positions near the front, rear, left, and right side surfaces (periphery) of the top surface of housing 1190, and at positions near the frame of opening 100A. Spacers 1802 may also be provided at other positions at appropriate intervals, thereby preventing deflection in the XY plane.

[0223] 21, in a modified example, diffuse reflecting member 1801 and spacer 1802 may be provided in the same position / area in diffuse reflecting layer 1701, which is the first layer. For example, diffuse reflecting member 1801b is provided on spacer 1802b. Alternatively, spacer 1802 and diffuse reflecting member 1801 may be formed integrally as the same member (in other words, a spacer having diffuse reflectivity).

[0224] The second layer, transparent substrate layer 1702, is provided at a position in the Z direction corresponding to side light source 1600, and guides the light emitted from side light source 1600 in a planar direction, for example, in the Y direction. FIG. 18, which will be described later, shows how the light is guided. The light from side light source 1600 is reflected by reflective layer 1903. The light from side light source 1600 is diffusely reflected in the Z direction by diffuse reflecting member 1801, and is emitted to the outside after passing through transmissive portion 1901 and decorative layer 1401. The emitted light forms graphic design display 1500.

[0225] Side light source 1600 may be configured using, for example, an LED device. Side light source 1600 has an optical axis that is roughly in a planar direction (e.g., the Y direction) as indicated by the dashed-dotted arrow. Side light source 1600 may include a reflector, a collimator, etc., so that it can efficiently emit light in the direction of this optical axis.

[0226] The third layer, the transmissive / non-transmissive layer 1703, has transmissive portions 1901 and non-transmissive portions 1902 repeatedly arranged at predetermined positions in a planar direction (for example, the Y direction). The shape of the predetermined graphic design display 1500 in a planar view (XY plane) is formed in accordance with the positions and shapes of the transmissive portions 1901 and non-transmissive portions 1902. The transmissive portions 1901 transmit light from the transparent substrate layer 1702.

[0227] 17 is made of air, a transparent material (film, resin, adhesive, etc.) may be formed therein. When a transparent material is formed in the transparent portion 1901, it is possible to prevent the decorative layer 1401 from bending and improve the flatness.

[0228] The non-transmitting portion 1902 does not transmit light from the transparent base material layer 1702. In this embodiment, the non-transmitting portion 1902 has a reflective layer 1903 provided on the lower side in the Z direction and a light-shielding layer 1904 provided on the upper side in the Z direction.

[0229] The reflective layer 1903 is formed of a reflective membrane or film, and improves the efficiency of light guide by reflecting the light from the side light source 1600 at the transparent substrate layer 1702 downward in the Z direction (FIG. 18). The reflective layer 1903 enables the light from the side light source 1600 to be guided farther, ensuring brightness in more distant areas.

[0230] The light-shielding layer 1904 is formed of a black printed layer or the like and blocks external light. This reduces glare caused by external light, enabling the graphic design display 1500 to achieve higher contrast. The light-shielding layer 1904 affects the contrast between the area where the illumination light is emitted (corresponding transmissive portion 1901) and the area where it is not emitted (corresponding non-transmissive portion 1902). It is desirable that the light-shielding layer 1904 have a transmittance of 10% or less. This makes the contrast ratio between the transmissive portion 1901 and the non-transmissive portion 1902 10:1. A contrast ratio of 10:1 allows a clear perception of the difference in brightness between these areas.

[0231] In this example, at the position of cross section AA, there are three white line areas that make up graphic design 1500B in Fig. 15 and one line area that makes up the frame of area C. Therefore, the corresponding cross section in Fig. 17 shows a case where four diffuse reflecting members 1801 and four transmissive portions 1901 are arranged at approximately regular intervals. However, the arrangement of diffuse reflecting members 1801, transmissive portions 1901, etc. may be configured according to the configuration of graphic design 1500.

[0232] FIG. 22 shows an example cross section of another graphic design 1500. In this example, multiple transmissive portions 1901 and non-transmissive portions 1902 are arranged at unequal intervals in the Y direction and with different widths. The lower part of FIG. 22 shows a line region 2200 in the XY plan view of the top surface corresponding to one side light source 1600. The line region 2200 corresponding to one side light source 1600 has a transmissive region 2201 corresponding to the transmissive portion 1901 and a non-transmissive region 2202 corresponding to the non-transmissive portion 1902. The arrangement of the transmissive portions 1901 and non-transmissive portions 1902 is designed in the line region 2200 at each position in the X direction. This allows for the realization of a graphic design display 1500 of any shape. Furthermore, the arrangement of the transmissive portions 1901 and non-transmissive portions 1902 is not limited to the X and Y directions, but may also be oblique to these directions.

[0233] [Design layer (3)] 18, corresponding to FIG. 17, shows an example of guided light rays when light from the side light source 1600 passes through the transparent base material layer 1702, the transmissive / non-transmissive layer 1703, and the decorative layer 1401 in the design layer 1400 and is emitted to the outside. Light traveling from the side light source 1600 roughly in the Y direction is guided while being reflected inside the transparent base material layer 1702. Of the guided light rays, those that are incident on the diffuse reflection member 1801 are diffusely reflected upward in the Z direction. The diffusely reflected light then passes through the transmissive portion 1901 and the decorative layer 1401 and is emitted to the outside, becoming the illumination light that forms the graphic design display 1500.

[0234] For example, light ray b1 from the side light source 1600 is diffusely reflected by the diffuse reflecting member 1801, and the diffusely reflected light ray b2 is transmitted upward through the transmissive portion 1901 and the decorative layer 1401. Furthermore, for example, light ray b3 from the side light source 1600 is totally reflected by the air in the diffuse reflecting layer 1701, and the reflected light ray b4 is guided in the planar direction (Y direction) through the transparent base material layer 1702. Furthermore, for example, light ray b5 from the side light source 1600 is reflected by the reflective layer 1903, and the reflected light ray b6 is guided in the planar direction (Y direction) through the transparent base material layer 1702. Furthermore, for example, light ray b7 from the side light source 1600 is totally reflected by the air in the transmissive portion 1901, and the reflected light ray b8 is guided in the planar direction (Y direction) through the transparent base material layer 1702. The light reflected and guided at each portion is diffusely reflected by the diffuse reflecting member 1801 as appropriate, and is emitted to the outside via the transmitting portion 1901.

[0235] Light emitted from a certain transmissive portion 1901 forms part of graphic design display 1500 in Figure 15 (for example, the white line area of ​​graphic design display 1500B). Also, external light e1 incident on design layer 1400 from the outside is blocked by light-shielding layer 1904 of non-transmissive portion 1902.

[0236] [Example of placement of mid-air operation detection sensors] FIG. 19 shows an example of the arrangement of the aerial operation detection sensor 1351 relative to the design layer 1400. The aerial operation detection sensor 1351 (area 1351a in FIG. 15) is arranged in an area outside the graphic design display 1500 in the planar direction (Y direction). The aerial operation detection sensor 1351 is arranged near the housing 1190 on the front of the device. In the Z direction, the aerial operation detection sensor 1351 is arranged, for example, near the diffuse reflection layer 1701. The direction of the optical axis 1351b of the detection light 1351c of the aerial operation detection sensor 1351 is a direction passing through the floating image 3 in space (diagonally upward). Furthermore, in the transparent / non-transparent layer 1703, a transparent portion 1901A (corresponding to area 1351a in FIG. 15) is provided at a position where the detection light 1351c of the aerial operation detection sensor 1351 is transmitted. This transmitting portion 1901A may be provided as a dedicated transmitting portion for transmitting the detection light 1351c, or may be provided as a dual-purpose transmitting portion that forms part of the graphic design 1500.

[0237] In another configuration example, the mid-air operation detection sensor 1351 may be installed near the transmission part 1901A in the Z direction.

[0238] [Decorative layer] FIG. 20 shows an example of the configuration of the decorative layer 1401. This shows an example that achieves a wood grain effect. The decorative layer 1401 has a configuration in which, for example, a decorative printed film 1401b is sandwiched between transparent base materials 1401a and 1401c. In this example, the decorative printed film 1401b is a film that has a wood grain pattern when viewed in the XY plane. The decorative layer 1401 may be composed of only the decorative printed film 1401b. Also, the transparent base material may be only one of 1401a or 1401c.

[0239] The decorative layer 1401 is composed of a light-transmitting printed film or a colored light-transmitting substrate or sheet (in other words, a translucent substrate or sheet). The printed film can be printed with various designs and patterns. Examples of colored light-transmitting substrates or sheets include smoked glass, smoked acrylic boards, and colored acrylic boards. By making the decorative layer uniform without a design or pattern, it is possible to suppress blurring of the spatial floating image 3 caused by the decorative layer 1401. In addition, it is possible to design the transmittance of the decorative layer 1401, and it is also possible to design how much light from the aforementioned transmissive portion 1901 is emitted to the outside.

[0240] [Variation: transparent / non-transparent layer] 23A and 23B show modified examples of the transmissive / non-transmissive layer 1703. In modified example A of FIG. 23A, the transmissive / non-transmissive layer 1703 has a reflective layer 1903 in the non-transmissive portion 1902 but does not have a light-shielding layer 1904. In modified example B of FIG. 23B, the transmissive / non-transmissive layer 1703 has a light-shielding layer 1904 in the non-transmissive portion 1902 but does not have a reflective layer 1903.

[0241] Although a configuration without reflective layer 1903 is possible, as in variant B of Figure 23B, a configuration with reflective layer 1903 is preferable because the efficiency of light guide in transparent substrate layer 1702 can be improved if reflective layer 1903 is present.

[0242] The graphic design display 1500 can be realized by designing whether or not the transparent portions 1901 and non-transparent portions 1902 are arranged in the transparent / non-transparent layer 1703. However, the graphic design display 1500 may also be realized by designing the transmittance of the transparent / non-transparent layer 1703 or the decorative layer 1401. For example, it is possible to design the display to have three regions with different transmittances, such as a region with a transmittance of 10%, a region with a transmittance of 50%, and a region with a transmittance of 90%.

[0243] In the above embodiment, the decorative layer 1401 and the transmissive / non-transmissive layer 1703 are separate layers, but this is not limiting and these layers may be implemented as an integrated unit. That is, a design made up of a transmissive portion 1901 and a non-transmissive portion 1902 may be implemented as an integrated unit inside the decorative layer 1401.

[0244] [Graphic design display] 24 is a plan view of the graphic design display 1500A. The background area B1 (shown in dark gray) is the area where the opaque parts 1902 are arranged in the transparent / opaque layer 1703 of the design layer 1400, and is the area where the decorative pattern (e.g., wood grain) of the decorative layer 1401 is mainly displayed. The area B2 (shown in white) is the area where the handprint 2001, arrow 2002, "Touch!" letters 2003, etc., that make up the graphic design are formed. The area B2 is the area where the transparent parts 1901 are arranged in the transparent / opaque layer 1703 of the design layer 1400, and the bright light emitted from the area B2 makes the decorative pattern of the decorative layer 1401 less visible / not noticeable.

[0245] In the example of graphic design display 1500A, user 230 is guided to view graphic design display 1500A from, for example, position Y2 in Fig. 14 and place / touch the handprint. When user 230 places / touches the handprint with his / her right hand, the position of the viewpoint of the head of user 230 is near viewing position 1302 (tolerance range 1303) in front of the device in Fig. 15. Therefore, from viewing position 1302, user 230 can recognize the presence of floating-in-space image 3 and can view floating-in-space image 3 favorably.

[0246] Similarly, other types of graphic design displays 1500B, 1500C can also inform user 230 of the presence of the floating image 3 in space and guide user 230 to the vicinity of viewing position 1302 on the front side of the floating image 3 in space.

[0247] [Sensor mechanism for graphic design display] 24 shows an example of a configuration in which a sensor mechanism capable of detecting that user 230 has placed his / her hand on / touched graphic design display 1500A is provided in graphic design display 1500A. Area B3 is provided at a position corresponding to handprint 2001, and is an area where a sensor for detecting that user 230 has placed his / her hand on / touched graphic design display 1500A is located.

[0248] FIG. 25A is a cross-sectional view of the design layer 1400 corresponding to region B3 in FIG. 24. A transmissive portion 1901B is provided in the transmissive / non-transmissive layer 1703 corresponding to region B3. A sensor 2500, such as an infrared sensor 2500, is disposed on the lower side of this transmissive portion 1901B in the Z direction, for example, on the diffuse reflection layer 1701. The detection light of the infrared sensor 2500 passes through the transmissive portion 1901B and the decorative layer 1401 in the Z direction. When the hand of the user 230 approaches / touches region B3, the infrared sensor 2500 detects that the detection light has been blocked. Alternatively, the infrared sensor 2500 detects infrared light reflected by the hand of the user 230. This makes it possible to detect that a hand has been placed on / touched / approached region B3 of the handprint 2001.

[0249] In addition, in Figure 25A, the aforementioned diffuse reflection member 1801 is not provided at the position of the infrared sensor 2500, so the light emitted from area B3 is relatively weak, and it becomes a darker area than the specified graphic design display 1500 (e.g., white area B2).

[0250] In the configuration example of FIG. 25A, the infrared sensor 2500 is hidden by the decorative layer 1401, which provides excellent design.

[0251] Alternatively, the sensor area may be provided so as to overlap area B2 of graphic design display 1500. For example, as in the modified example of Figure 25B, infrared sensor 2500 may be disposed adjacent to diffuse reflection layer 1801 so that the optical axis of the detection light is oblique to transmissive section 1901 where diffuse reflection layer 1801 is located.

[0252] The space-floating image display device 1000 can perform predetermined control depending on whether a hand is placed on the display, as detected by the sensor mechanism of the graphic design display 1500. As an example of control, the space-floating image display device 1000 may switch the display of the space-floating image 3 to an on state when a hand is placed on the display.

[0253] The sensor mechanism is not limited to an infrared sensor, and may be implemented using other types of sensor devices. For example, an electrostatic sensor may be used. For example, the electrostatic sensor may be disposed in a position that does not block the light guided from the side light source 1600, such as the non-transmitting portion 1902 on the upper side of the transparent base layer 1702 or an empty position on the lower side of the transparent base layer 1702.

[0254] In another modification, the non-transmitting portion 1902 may have the property of transmitting infrared light from the infrared sensor 2500. In this case, the infrared sensor 2500 can be disposed at a position corresponding to the non-transmitting portion 1902.

[0255] [Modification: Diffuse Reflection Layer] FIG. 26 shows a modified example of the diffuse reflection layer 1701 (diffuse reflection member 1801). In the modified example of FIG. 26, a textured portion 2601 or a prism-shaped portion 2602 is provided on the upper surface of the diffuse reflection layer 1701, in other words, on the lower surface 1702a of the transparent base layer 1702, instead of the above-described diffuse reflection member 1801. FIG. 26 illustrates these textured portions together. As shown in the figure, the groove direction of the prism-shaped portion 2602 is a direction (groove direction g1, for example, the X direction) that is orthogonal to the optical axis direction c1 of the light from the side light source 1600 (for example, the Y direction). The textured portion 2601 may have a shape that has textured portions in one direction or in multiple directions.

[0256] These uneven portions provide a diffuse reflection function, thereby providing the same effect as in Example 2 (FIG. 18, etc.).

[0257] [Variation: Graphic design display device] FIG. 27 shows a modified example of side light source 1600, diffuse reflective layer 1701, etc. In the modified example of FIG. 27, side light source 1600 is not provided, and instead, a display device (graphic design device) 2700, such as a liquid crystal panel or electronic paper, is provided on the upper surface of diffuse reflective layer 1701, in other words, on lower surface 1702a of transparent substrate layer 1702. Display device 2700 includes a backlight and other components. Reflective layer 1903 is not required in transmissive / non-transmissive layer 1703, and light-shielding layer 1904 is included. Transmissive portion 1901D is provided in a relatively wide region of transmissive / non-transmissive layer 1703 corresponding to display device 2700. Display device 2700 displays an image on display screen 2700a under control. This image corresponds to arbitrary graphic design display 1500. A light ray d1 of a display image from the display screen 2700a of the display device 2700 is transmitted through the transmissive portion 1901D and the decorative layer 1401. This allows an arbitrary graphic design display 1500 to be displayed in the area corresponding to the transmissive portion 1901D.

[0258] [Variation: Light source device for graphic design] 28 , a light source device 2800 may be provided below the transmissive portion 1901 in the area where the graphic design display 1500 is provided, without providing the side light source 1600 and the diffuse reflector 1801. The light source device 2800 emits light in the Z direction. The light passes through the transmissive portion 1901 and the decorative layer 1401 and is emitted to the outside, forming the graphic design display 1500.

[0259] [Graphics Design Display On / Off] The space floating image display device 1000 of the second embodiment can also control the on (lighting) / off (non-lighting) of the graphic design display 1500. An example of controlling the on / off of the graphic design display 1500 is shown below.

[0260] 14, the space-floating image display device 1000 uses a camera or the like of the imaging unit 1180 to distinguish and detect at least two states: when the user 230 is not near the device, and when the user 230 is near the device (for example, near position Y1). The space-floating image display device 1000 may also measure the distance between the user 230 and the front of the device (for example, distance 1307). The space-floating image display device 1000 (image processing unit 1001 in FIG. 30 described below) controls the display of the graphic design display 1500 and the space-floating image 3 according to the detected state (approach / departure, distance, etc.).

[0261] [Control example] Fig. 29 is a table summarizing control examples regarding the on / off of the graphic design display. Control example #1 is condition 1, in which when the device is not in use, the display of the floating image 3 in space is turned off, and the guidance display by the graphic design 1500 is turned off. Control example #2 is condition 2, in which when the device is in use, the display of the floating image 3 in space is turned on, and the guidance display by the graphic design 1500 is turned on. Control example #2 may also be applied during normal use when the device is powered on.

[0262] As other control examples, control examples #3 and #4 may be applied. In control example #3, when the user 230 is not near the front of the device, the space-floating image display device 1000 turns off (hides) the display of the space-floating image 3 and turns on the guidance display using the graphic design 1500, as condition 3. Specifically, the space-floating image display device 1000 turns on (turns on) the side light source 1600. As a result, as in the example of FIG. 15, the graphic design display 1500 (white area) stands out against the decorative layer 1401 of the design layer 1400, making it easy to see. In control example #3, power can be saved by hiding the space-floating image 3.

[0263] In addition, in control example #4, as condition 4, when the user 230 approaches near the front of the device (for example, when detected near position Y1 in Figure 14), the space floating image display device 1000 switches the display of the space floating image 3 to the ON state, and keeps the guidance display using the graphic design 1500 in the ON state.

[0264] As another control example, control example #5 may be applied. In control example #5, when condition 5 is met, the space-floating image display device 1000 turns on the display of the space-floating image 3, and switches off the guidance display by the graphic design 1500. This saves power by not displaying the guidance display. Also, by making the surroundings of the space-floating image 3 as dark as possible, the space-floating image 3 becomes easier to see.

[0265] Condition 5 can be when a camera or the like detects that the viewpoint position of the user 230 is near the preferred viewing position 1302. Condition 5 can also be when the mid-air operation detection sensor 1351 detects that the user 230 is manipulating the floating image 3 in mid-air with their fingers. Condition 5 can also be when a sensor mechanism detects that the user 230 is placing / touching / bringing their hand close to a guidance display unit such as the graphic design 1500A mentioned above.

[0266] As another example of control, when it is detected that the user 230 has not operated the floating image 3 in the air for a certain period of time or when a predetermined OFF operation is performed, the floating image 3 may be hidden (turned off) and the graphic design display 1500 may be turned on again (as in control example #3).

[0267] [Control Unit] 30 shows a configuration example in which the control unit 1110 of the space-floating image display device 1000 automatically controls the graphic design display 1500, etc. The space-floating image display device 1000 has an image processing unit 1001, a display unit 1002, an optical system 1003, a user operation detection mechanism 1004, a memory (storage unit) 1005, a communication unit 1132, an operation input unit 1107, etc. The image processing unit 1001 corresponds to the control unit 1110, the image control unit 1160, the mid-air operation detection unit 1350, etc. in FIG. 3. The display unit 1002 corresponds to the image display device 1 in FIG. 3 or FIG. 14. The optical system 1003 corresponds to the retroreflector 1101 in FIG. 3 or the beam splitter 101 and retroreflector 2, etc. in FIG. 14. The user operation detection mechanism 1004 has an mid-air operation detection sensor 1351 and an imaging unit 1180.

[0268] The image processing unit 1001 automatically executes control (for example, FIG. 29) according to setting information in the memory 1005, or user instruction input from the communication unit 1132 or operation input unit 1107, or detection of user instruction input to the floating image 3. The setting information includes setting information regarding what kind of control example to apply, etc.

[0269] In this embodiment, the image processing unit 1001 estimates and detects, for example, the approach / departure and distance of the user 230 based on the data of the image captured by the camera of the imaging unit 1180. Furthermore, the image processing unit 1001 may estimate and detect whether or not an operation is being performed in mid-air on the floating in space image 3 based on the data of the image captured by the camera of the imaging unit 1180.

[0270] The image processing unit 1001 first checks and determines the conditions based on the settings of the control example shown in Fig. 29. In doing so, the image processing unit 1001 grasps the state of the user 230 based on the imaging unit 1180, the mid-air operation detection sensor 1351, the infrared sensor 2500, etc. For example, assume that control example #3 is applied. If the image processing unit 1001 determines that the user 230 is not near the front of the device, it controls the display unit 1002, etc. to hide the floating-in-space image 3. In addition, the image processing unit 1001 controls the side light source 1600 to turn on, thereby controlling the graphic design display 1500 to be lit.

[0271] [Side light source control: local dimming] FIG. 31 shows a configuration example of a planar view of the top surface of the housing 1190 of the space-floating image display device 1000 according to another embodiment of the second embodiment. In this embodiment, local dimming is applied to a predetermined graphic design display 1500. Local dimming refers to the concept of adjusting and controlling the amount of light for each area. The space-floating image display device 1000 controls partial on / off of the graphic design display 1500 as local dimming by turning on / off each light source of the side light source 1600 for each area on the top surface of the housing 1190.

[0272] In FIG. 31 , side light source 1600, which includes an array of multiple (N) light sources, is arranged along the right side (Y direction) of housing 1190 in the X direction. The optical axis of each light source of side light source 1600 travels from right (+X) to left (-X) in the X direction. Each light source of side light source 1600 has a light-guiding line region 3100, and this line region 3100 is the target of local dimming. Line region 3100 is a region obtained by dividing the top surface into multiple regions. For example, first light source 1600-1, located on the far side (+Y) in the Y direction, has line region 3100-1, and Nth light source 1600-N, located on the near side (-Y) in the Y direction, has line region 3100-N.

[0273] In the example of Figure 31, in order to perform local dimming control using multiple line areas 3100 obtained by dividing the top surface of the housing 1190 in the Y direction, the side light sources 1600 are arranged along the Y direction on one side in the X direction.

[0274] For example, when the first light source 1600-1 is turned on, light can be guided through the line region 3100-1, so if there is a graphic design display area (white area in the illustration) formed by the aforementioned transmissive portion 1901 arranged corresponding to the line region 3100-1, the display (in other words, lighting) in the graphic design display area is turned on. When the light source 1600-1 is turned off, the display in the graphic design display area formed by the transmissive portion 1901 arranged corresponding to the line region 3100-1 is turned off.

[0275] Side light sources 1600 may be provided in positions and in numbers corresponding to the areas where graphic design display 1500 is provided. In the example shown, graphic design display 1500 is not provided in area 3190 on the back side in the Y direction on the top surface or in area 1351a of aerial operation detection sensor 1351 on the front side, so individual light sources of side light sources 1600 and line areas 3100 are not provided in these areas. In the example shown, graphic design display 1500 is provided mainly in area 1510 on the front side and in area C (graphic design display 1500D) of the frame of image light output unit 100A, so divided side light sources 1600 and line areas 3100 are provided to cover these areas.

[0276] 31, a collimator lens 1620 is also provided for each of the side light sources 1600. Providing the collimator lenses 1620 makes it easier to clearly separate the local dimming areas. Light emitted from the light sources is converted into approximately parallel light by the collimator lenses 1620, and travels efficiently through the line area 3100 along the optical axis toward the other end where no side light source 1600 is present.

[0277] The configuration is not limited to the example shown in Figure 31. The same applies when providing side light sources 1600 on the side surfaces along the X direction, as described above. Furthermore, for example, side light sources 1600 may be provided on both the left and right ends in the X direction, and light may be guided from both the left and right simultaneously. Furthermore, as in Figure 15, side light sources 1600 capable of local dimming may be provided on the front or back of the device in the Y direction, and light may be guided in the Y direction.

[0278] 32A and 32B show an example of on / off display of graphic design display 1500 using local dimming corresponding to the configuration of Fig. 31. The number of light sources is N=16, which corresponds to 16 line regions 3100. Graphic design display 1500 includes graphic design displays 1500A and 1500B, and graphic design display 1500D corresponding to the frame portion (region C) of image light output unit 100A.

[0279] State A in FIG. 32A is an example of a state using local dimming, in which the far edge of the frame of the image light output unit 100A (area C, graphic design display 1500D) is unlit. By turning off only the first light source, the first line region 3100-1 is turned off and becomes an unlit region such as region C1. Other regions of the frame of the image light output unit 100A become lit regions such as region C2. The unlit regions are displayed darker than the lit regions. The unlit region of region C1 is illustrated in black for ease of understanding, but if the decorative layer 1401 is present in region C1, region C1 will blend in with the pattern of the decorative layer 1401 and be displayed at a similar brightness.

[0280] In state A, when user 230 views space-floating image 3 from viewing position 1302, the far side edge of the frame of image light output unit 100A in the background of space-floating image 3 is unlit as in region C1, making it easier to view space-floating image 3. When space-floating image 3 is displayed, graphic design display 1500 in the background or surrounding space-floating image 3 as seen by user 230 may reduce the visibility of space-floating image 3. In this case, by using the above-mentioned local dimming to unlight a portion of graphic design display 1500, the visibility of space-floating image 3 can be ensured.

[0281] State B in FIG. 32B is another example of a local dimming state, in which graphic design displays 1500A and 1500B are unlit. In this example, graphic design displays 1500A and 1500B (region 1510) are located in an area further forward than the front (-Y) edge of image light output unit 100A (corresponding to the line region of the 13th light source). In this example, graphic design displays 1500A and 1500B correspond to line regions 3100 numbered 14, 15, and 16. By turning off the light sources numbered 14, 15, and 16, line regions 3100 are turned off, resulting in unlit regions such as region C3. The unlit regions of graphic design displays 1500A and 1500B appear darker than the lit regions such as region C of the frame. The unlit area of ​​area C3 is illustrated in black for ease of understanding, but if the decorative layer 1401 is present, it will be displayed with the same brightness and blend into the pattern of the decorative layer 1401.

[0282] In state B, the frame portion of area C (graphic design display 1500D) stands out from the view of user 230. By turning off graphic design displays 1500A and 1500B, power can be saved.

[0283] 32C is a schematic diagram showing an example of another state in which all of the side light sources 1600 are turned off, causing all of the graphic design displays 1500 (including frame area C) to be turned off (unlit). The graphic design displays 1500 (1500A, 1500B, 1500D) blend into the pattern of the decorative layer 1401 and are not noticeable to the user 230.

[0284] [Variation: Side light source: 2D] Fig. 33 shows an example of the configuration of a modified side light source 1600. This modified example includes both side light sources 1600X arranged along the X direction and side light sources 1600Y arranged along the Y direction; in other words, a two-dimensional side light source 1600. It has line regions 3100X formed by the side light sources 1600X and line regions 3100Y formed by the side light sources 1600Y. It has a matrix (e.g., 16 x 16) of regions where the line regions in the X and Y directions intersect (intersection regions 3300). Each intersection region 3300 can be turned on / off.

[0285] Examples of local dimming control in FIG. 33 include the following. For example, to light up the back side of area C (graphic design display 1500D) of the frame of the image light emitting unit 100A, the first light source of the side light source 1600Y can be turned on. To light up the front side of the frame, the thirteenth light source of the side light source 1600Y can be turned on. To light up the right side of the frame, the fourth light source of the side light source 1600X can be turned on. To light up the left side of the frame, the fourteenth light source of the side light source 1600X can be turned on. Furthermore, to light up only the graphic design display 1500A, for example, the first, second, and third light sources of the side light source 1600X can be turned on.

[0286] Furthermore, if it is desired to increase the brightness of each intersection region 3300, it is possible to turn on both the corresponding light source of the side light source 1600X and the corresponding light source of the side light source 1600Y. For example, if it is desired to turn on the graphic design display 1500A more brightly, it is possible to turn on the first, second, and third light sources of the side light source 1600X and the fourteenth, fifteenth, and sixteenth light sources of the side light source 1600Y.

[0287] However, in a configuration of side light sources 1600 with at least one-dimensional arrangement (a configuration with multiple light sources capable of local dimming), such as those shown in FIG. 15, FIG. 31, or FIG. 33, it may not be possible to turn on or off only some of the graphic design displays 1500, even if desired. For example, if you want to turn on only graphic design display 1500B, you must turn off graphic design display 1500A and graphic design display 1500D. In this case, in any of the configurations of side light sources 1600, it is not possible to turn on only graphic design display 1500B. This is because graphic design display 1500B is aligned with graphic design display 1500A in the X direction and with graphic design display 1500D in the Y direction.

[0288] For example, in Figure 33, even if side light source 1600X is controlled by local dimming, graphic design display 1500B and graphic design display 1500D, which are on the same line area 3100X, will have the same on / off state. Also, even if side light source 1600Y is controlled by local dimming, graphic design display 1500A and graphic design display 1500B, which are on the same line area 3100Y, will have the same on / off state.

[0289] [Side light source control: local dimming (2)] Fig. 34 shows another example of control of side light source 1600 and local dimming, showing the portion of graphic design 1500A on the top surface of housing 1190. As with Fig. 33, this example includes both side light sources 1600X arranged in the X direction and side light sources 1600Y arranged in the Y direction. The configuration of Fig. 34 also assumes the use of the configuration of prism-shaped portion 2602 with diffuse reflection function of the modified example of Fig. 26.

[0290] In this example, graphic design display 1500A includes a handprint 2001 and "ON" and "OFF" characters 2004 located in front of handprint 2001. In this example, in the area corresponding to "ON" and "OFF" characters 2004, the prism groove directions of prism-shaped portion 2602 in FIG. 26 are different vertically and horizontally between "ON" character area 2004A (i.e., first guidance display section) and "OFF" character area 2004B (i.e., second guidance display section). In other words, the prism groove direction of "ON" character area 2004A and the prism groove direction of "OFF" character area 2004B are orthogonal to each other. Furthermore, the on / off control of vertical and horizontal side light sources 1600 (1600X, 1600Y) for the area is combined. This allows the "ON" character area 2004A (first guidance display section) and the "OFF" character area 2004B (second guidance display section) to be lit or unlit depending on the on / off state of the side light source 1600. Fig. 34 shows a case where the handprint 2001 portion is lit, the "ON" character area 2004A is lit, and the "OFF" character area 2004B is unlit.

[0291] The area of ​​handprint 2001 does not have prism-shaped portion 2602, but has diffuse reflecting member 1801 as shown in FIG. 18 etc. In other words, in this embodiment, the implementation of diffuse reflecting layer 1701 is configured differently between the area of ​​handprint 2001 and the area of ​​letters "ON" and "OFF" 2004. As a result, the area of ​​handprint 2001 is lit regardless of which direction side light source 1600 is turned on, whereas the area of ​​letters "ON" and "OFF" 2004 can be turned on or off depending on which direction side light source 1600 is selected to be turned on.

[0292] FIG. 35 is an enlarged view of the area of ​​the "ON" and "OFF" characters 2004 in FIG. 34. State A is when the "ON" character area 2004A is lit and the "OFF" character area 2004B is unlit. State B is when the "ON" character area 2004A is unlit and the "OFF" character area 2004B is lit. State A is a case where guidance is given to inform the user 230 of the "ON" state, and state B is a case where guidance is given to inform the user 230 of the "OFF" state.

[0293] In "ON" character region 2004A, the direction of the prism grooves in prism-shaped portion 2602 of diffuse reflecting layer 1701 extends in the X direction, as shown in the figure. Stripe lines 3501 schematically illustrate the prism groove direction (X direction). In "OFF" character region 2004B, the direction of the prism grooves in prism-shaped portion 2602 of diffuse reflecting layer 1701 extends in the Y direction, as shown in the figure. Stripe lines 3502 schematically illustrate the prism groove direction (Y direction).

[0294] Light incident from a light source in a direction perpendicular to the prism groove direction of prism-shaped portion 2602 is scattered with high efficiency in the Z direction, while light incident from a light source in a direction parallel to the direction is not scattered much. By switching on / off the side light sources 1600X aligned in the X direction and the side light sources 1600Y aligned in the Y direction, the lighting area of ​​the graphic design display section (the area from which illumination light is emitted outside) can be controlled.

[0295] To achieve state A, side light source 1600X is turned on, and side light source 1600Y is turned off. Light traveling in the Y direction from side light source 1600X is diffusely reflected in the Z direction with high efficiency by the X-direction grooves in prism-shaped portion 2602 of "ON" character region 2004A, and is emitted to the outside via transmissive portion 1901. In other words, "ON" character region 2004A is lit (shown in white text). On the other hand, light traveling in the Y direction from side light source 1600X is not diffusely reflected in the Z direction much by the Y-direction grooves in prism-shaped portion 2602 of "OFF" character region 2004B, and is not emitted to the outside. In other words, "OFF" character region 2004B is unlit (shown in dotted text). When viewed from the user 230, the "ON" character region 2004A appears bright and conspicuous, while the "OFF" character region 2004B blends into the pattern of the decorative layer 1401 and appears inconspicuous.

[0296] To achieve state B, side light source 1600Y is turned on, and side light source 1600X is turned off. Light traveling in the X direction from side light source 1600Y is diffusely reflected in the Z direction with high efficiency by the Y-direction grooves of prismatic portion 2602 of "OFF" character region 2004B, and is emitted to the outside via transmissive portion 1901. In other words, "OFF" character region 2004B is lit. On the other hand, light traveling in the X direction from side light source 1600Y is not diffusely reflected in the Z direction by the X-direction grooves of prismatic portion 2602 of "ON" character region 2004A, and is not emitted to the outside. In other words, "ON" character region 2004A is unlit. From the perspective of user 230, "OFF" character region 2004B appears bright and conspicuous, while "ON" character region 2004A blends in with the pattern of decorative layer 1401 and appears inconspicuous.

[0297] In state A or state B, the portion of handprint 2001 in FIG. 34 is illuminated because side light source 1600X or side light source 1600Y is on. In state A, the ON state of handprint 2001 can be communicated to user 230, and in state B, the OFF state of handprint 2001 can be communicated. For example, space-floating image display device 1000 uses a sensor mechanism such as those shown in FIGS. 24 and 25A to detect whether user 230 has placed their hand on handprint 2001. When a hand is placed, space-floating image display device 1000 may turn on side light source 1600X and illuminate "ON" character region 2004A, as in state A, and when a hand is not placed, turn on side light source 1600Y and illuminate "OFF" character region 2004B, as in state B.

[0298] 34 and 35, it is not necessarily necessary to individually control the multiple light sources of the side light source 1600. When this configuration is applied, the graphic design display 1500A (especially the ON / OFF characters) is located near the user 230 on the front of the device and is easy for the user 230 to understand.

[0299] As an example of use (display control example) of "ON" character area 2004A and "OFF" character area 2004B, when user 230 places their hand on handprint 2001, the "ON" character may be lit and the floating-in-space image 3 may be displayed, and when user 230 does not place their hand, the "OFF" character may be lit and the floating-in-space image 3 may be hidden. Alternatively, when user 230 places their hand on handprint 2001 once, the "ON" character may be lit and the floating-in-space image 3 may be displayed, and this state may continue even if the hand is removed. Then, when user 230 places their hand on handprint 2001 again, the "OFF" character may be lit and the floating-in-space image 3 may be hidden, and this state may continue even if the hand is removed. In other words, the ON / OFF state may be alternately switched each time a hand is placed.

[0300] In addition to the prism-shaped portion 2602, a diffuse reflection member 1801 and a diffuse reflection layer 1701 that similarly have diffuse reflection directionality can also be applied.

[0301] In the configuration examples of FIGS. 34 and 35 , for example, when the “OFF” character area 2004B is turned off, the “OFF” character blends into the pattern of the decorative layer 1401 and becomes almost invisible to the user 230. This configuration is not limited to this, and it is also possible to configure the graphic design display area to be turned off so that it does not blend into the pattern of the decorative layer 1401, for example by displaying it in black. This configuration may be such that the pattern of the decorative layer 1401 is not provided in the target graphic design display area (for example, the “ON” character area 2004A and the “OFF” character area 2004B). In this case, the target graphic design display area is displayed in bright white when the side light source 1600 is on, and in dark black when the side light source 1600 is off.

[0302] FIG. 36 shows a modified example using another graphic design display, in which the decorative layer 1401 pattern is not provided in the "AA" character region 2004A and the "BB" character region 2004B. For example, the region forming the "AA" character has a transmissive portion 1901, but no decorative layer 1401 pattern is provided. State A is when both the side light source 1600X and the side light source 1600Y are off, and the "AA" and "BB" characters are displayed in black. State B is when both the side light source 1600X and the side light source 1600Y are on, and the "AA" and "BB" characters are displayed in white. State C is when the side light source 1600X is on and the side light source 1600Y is off, and the "AA" characters are displayed in white and the "BB" characters are displayed in black. State D is when the side light source 1600X is off and the side light source 1600Y is on, and the letters "AA" are displayed in black and the letters "BB" are displayed in white.

[0303] As in the above example, by using a configuration in which areas with different implementations of the diffuse reflection layer 1701 (directions that receive diffuse reflection) are arranged side by side, a configuration with or without a pattern on the decorative layer 1401, and a configuration of side light sources 1600 in each direction, it is possible to control multiple display states for multiple parts of the graphic design display 1500.

[0304] The technology according to this embodiment displays high-resolution, high-brightness video information in a state where it floats in space, allowing users to operate the device without worrying about contact infection. Applying the technology according to this embodiment to a system used by an unspecified number of users reduces the risk of contact infection and makes it possible to provide a contactless user interface that can be used without anxiety. This contributes to the "Good Health and Well-Being" goal, one of the Sustainable Development Goals (SDGs) advocated by the United Nations.

[0305] Furthermore, the technology of this embodiment reduces the divergence angle of the emitted image light and aligns it with a specific polarization, thereby efficiently reflecting only the normal reflected light from the retroreflector, thereby enabling high light utilization efficiency and producing bright and clear floating images in space.The technology of this embodiment can provide a highly usable non-contact user interface that can significantly reduce power consumption.This contributes to the achievement of the United Nations' Sustainable Development Goals (SDGs): "Build resilient infrastructure, promote inclusive and sustainable industrialization, and promote technological innovation and infrastructure" and "Make cities and human settlements sustainable."

[0306] Although various embodiments have been described above in detail, the present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments are detailed descriptions of the entire system to clearly explain the present invention, and the present invention is not necessarily limited to a system including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with other configurations. [Explanation of symbols]

[0307] 1...display device, 3...space-floating image, 100...transparent member, 100A...image light emitting section, 230...user, 1000...space-floating image display device, 1302...viewing position, 1400...design layer, 1500 (1500A, 1500B, 1500C, 1500D)...graphic design display, 1600...light source (side light source).

Claims

1. A floating-in-the-air image display device that displays floating-in-the-air images, a video processing unit that processes video; a display device that emits image light based on the image processed by the image processing unit; an optical system that forms a floating image based on the image light emitted by the display device; a housing for holding the display device and the optical system; Equipped with a light-transmitting member in the housing having an image light emitting portion through which image light forming the floating image is emitted to the outside, a design layer for displaying a graphic design of a user interface related to the floating image, the design layer having a transparent portion and a non-transparent portion; a light source that emits light to the outside through the transparent portion of the design layer to form the graphic design, A floating video display device.

2. 2. The floating-in-the-air image display device according to claim 1, The light-transmitting member has a decorative printing layer through which light passes to form the graphic design. A floating video display device.

3. 2. The floating-in-the-air image display device according to claim 1, the light source is disposed along an edge of the light-transmitting member, and light supplied from the light source is incident on the light-transmitting member in a direction substantially parallel to the surface of the light-transmitting member; The light-transmitting member has a diffuse reflection portion in an area overlapping the light-transmitting portion of the design layer in a planar direction, the diffuse reflection portion diffusing and reflecting the light from the light source toward the light-transmitting portion. A floating video display device.

4. 2. The floating-in-the-air image display device according to claim 1, The non-transmitting portion of the design layer has at least one of a light-shielding layer that blocks external light and a reflective layer that reflects light from the light source. A floating video display device.

5. 2. The floating-in-the-air image display device according to claim 1, the graphic design of the design layer has an indication that notifies a user of the presence of the floating image; A floating video display device.

6. 2. The floating-in-the-air image display device according to claim 1, the graphic design of the design layer has a display that guides a user to a viewing position of the floating image; A floating video display device.

7. 2. The floating-in-the-air image display device according to claim 1, turning on the light source when it is necessary to guide the user by displaying the graphic design of the design layer, and turning off the light source when it is not necessary to guide the user. A floating video display device.

8. 2. The floating-in-the-air image display device according to claim 1, When a user is not approaching the floating-in-the-air image display device or the floating-in-the-air image, the light source is turned on. A floating video display device.

9. 2. The floating-in-the-air image display device according to claim 1, When a user is not approaching the floating-in-the-air image display device or the floating-in-the-air image, the display of the floating-in-the-air image is turned off and the light source is turned on, and when the user approaches, the display of the floating-in-the-air image is turned on and the light source is turned off. A floating video display device.

10. 2. The floating-in-the-air image display device according to claim 1, The light transmitting member is a diffuse reflection layer that diffuses and reflects light from the light source; a transparent substrate layer formed on the diffuse reflection layer for guiding light from the light source; the design layer formed on the transparent substrate layer; a decorative print layer formed on the design layer and through which light passes to form the graphic design; A floating video display device.

11. 2. The floating-in-the-air image display device according to claim 1, the light transmitting member has a diffuse reflection layer that diffuses and reflects light from the light source, The diffuse reflective layer is Air and A spacer; a diffuse reflection section that is arranged at a position overlapping the transmission section and that diffuses and reflects the light from the light source, A floating video display device.

12. 2. The floating-in-the-air image display device according to claim 1, an aerial operation detection sensor for detecting an aerial operation on the floating-in-the-air image; the aerial operation detection sensor is disposed at a position on the housing such that a detection optical axis passes through a plane of the floating-in-the-air image, The detection optical axis of the aerial operation detection sensor passes through the transparent portion of the design layer. A floating video display device.

13. 2. The floating-in-the-air image display device according to claim 1, the graphic design of the design layer is provided with a sensor mechanism for detecting the proximity of a user's hand; a detection optical axis of the sensor mechanism passes through the transparent portion of the design layer; A floating video display device.

14. 2. The floating-in-the-air image display device according to claim 1, the light transmitting member has a transparent substrate layer that guides light from the light source in a planar direction of the light transmitting member, The transparent substrate layer has, on a surface opposite to the transmissive portion and the non-transmissive portion, a diffuse reflection section that is arranged at a position overlapping the transmission section and that diffuses and reflects light from the light source; The diffuse reflection portion is formed as an uneven portion having grooves extending in a predetermined direction in the planar direction. A floating video display device.

15. 2. The floating-in-the-air image display device according to claim 1, the light source is a display device that displays an image for forming the graphic design and emits the light based on the image. A floating video display device.

16. 2. The floating-in-the-air image display device according to claim 1, the light source is a side light source that is arranged along an edge of the light-transmitting member in the housing and supplies light in a substantially planar direction of the light-transmitting member, a diffuse reflection portion that diffuses and reflects light from the light source toward the transmission portion in an area of ​​the design layer that overlaps the transmission portion in the planar direction; the side light source has a plurality of light sources corresponding to a plurality of divided regions on a plane of the light transmitting member, By controlling on / off of individual light sources among the plurality of light sources of the side light source, display of the graphic design is turned on / off in individual areas corresponding to the individual light sources on the plane of the light-transmitting member. A floating video display device.

17. 17. The airborne image display device according to claim 16, The side light source includes a first side light source provided on a side of the housing facing the light transmitting member so as to extend in a first direction, and a second side light source provided on a side of the housing facing the light transmitting member so as to extend in a second direction. A floating video display device.

18. 18. The airborne image display device according to claim 17, The graphic design of the light-transmitting member is a first graphic design portion provided in an area corresponding to a first diffuse reflection portion that diffusely reflects light from the first side light source and does not diffusely reflect light from the second side light source; a second graphic design portion provided in an area corresponding to a second diffuse reflecting portion that diffusely reflects light from the second side light source but does not diffusely reflect light from the first side light source, When the first side light source is in an on state, the display of the first graphic design portion is turned on, and when the second side light source is in an on state, the display of the second graphic design portion is turned on. A floating video display device.

Images