Airborne display device

Abstract

The present invention provides an aerial display device capable of displaying two different aerial images. [Solution] The aerial display device includes a display element 10, an optical splitting element 20, an optical control element 30, and an optical element 40. The display element 10 has a plurality of first element pixels and a plurality of second element pixels, each extending in a first direction and arranged alternately in a second direction, the plurality of first element pixels display a first image, and the plurality of second element pixels display a second image. The optical splitting element 20, when viewed from the first direction, emits light emitted from the plurality of first element pixels in a diagonal direction to the right, and emits light emitted from the plurality of second element pixels in a diagonal direction to the left. The optical control element 30, when viewed from the second direction, transmits the diagonal light component of the light from the optical splitting element 20. The optical element 40 reflects the light emitted from the optical control element 30 to the opposite side of the optical control element 30, forming an aerial image in the air.

Description

[Technical Field]

[0001] This invention relates to an aerial display device. [Background technology]

[0002] Aerial display devices capable of displaying images and videos as aerial images are being researched and are expected to be a new human-machine interface. These aerial display devices project a real image into the air by reflecting light emitted from the display surface of a display element using an imaging element.

[0003] In Patent Document 1, the aerial display device displays an aerial image parallel to the imaging element. In Patent Document 1, the aerial image has a wide viewing angle in one axis direction. The aerial display device in Patent Document 1 displays the same image (or video) as the aerial image. [Prior art documents] [Patent Documents]

[0004] [Patent Document 1] Patent No. 7184220 [Overview of the project] [Problems that the invention aims to solve]

[0005] The present invention provides an aerial display device capable of displaying two different aerial images. [Means for solving the problem]

[0006] According to a first aspect of the present invention, a display element having a plurality of first element pixels and a plurality of second element pixels, wherein each of the plurality of first element pixels extends in a first direction and is arranged in a second direction orthogonal to the first direction, each of the plurality of second element pixels extends in a first direction and is arranged in the second direction, the plurality of first element pixels and the plurality of second element pixels are arranged alternately, the plurality of first element pixels display a first image, and the plurality of second element pixels display a second image, and a display element arranged to receive light from the display element, the first An aerial display device is provided, comprising: an optical splitting element that, when viewed from a direction, emits light emitted from a plurality of first element pixels in a diagonal direction to the right and light emitted from a plurality of second element pixels in a diagonal direction to the left; an optical control element that is positioned to receive light from the optical splitting element and transmits the diagonal light component of the light from the optical splitting element when viewed from the second direction; and an optical element that is positioned to receive light from the optical control element and reflects the light emitted from the optical control element to the opposite side of the optical control element, thereby forming an aerial image in the air.

[0007] According to a second aspect of the present invention, an aerial display device according to the first aspect is provided, wherein the optical element forms a first aerial image based on the first image and forms a second aerial image based on the second image, the first aerial image is visible to a first observer on the right side when viewed from the first direction, and the second aerial image is visible to a second observer on the left side when viewed from the first direction.

[0008] According to a third aspect of the present invention, an aerial display device according to the first aspect is provided, wherein the optical element includes a planar substrate and a plurality of optical elements provided below the substrate, each extending in the second direction and arranged in the first direction, and each of the plurality of optical elements is inclined with respect to the normal direction of the substrate and has an incident surface and a reflective surface that are in contact with each other.

[0009] According to a fourth aspect of the present invention, an aerial display device according to the first aspect is provided, wherein the light control element includes a plurality of transparent members and a plurality of light-shielding members, each of the plurality of transparent members extending in the second direction and aligned in the first direction, each of the plurality of light-shielding members extending in the second direction and aligned in the first direction, the plurality of transparent members and the plurality of light-shielding members are arranged alternately, and the plurality of light-shielding members are inclined with respect to the normal of the light control element.

[0010] According to a fifth aspect of the present invention, an aerial display device according to the first aspect is provided, wherein the light-dividing element has a plurality of transparent regions and a plurality of light-shielding regions, each of the plurality of transparent regions extending in a first direction and aligned in a second direction, each of the plurality of light-shielding regions extending in a first direction and aligned in a second direction, and the plurality of transparent regions and the plurality of light-shielding regions are arranged alternately.

[0011] According to a sixth aspect of the present invention, an aerial display device according to the fifth aspect is provided, wherein the light-dividing element includes a planar transparent member and a plurality of light-shielding layers provided on the transparent member, the plurality of light-shielding layers each extend in a first direction and are arranged at intervals in a second direction, and the plurality of light-shielding layers are each arranged in the plurality of light-shielding regions.

[0012] According to a seventh aspect of the present invention, an aerial display device according to the fifth aspect is provided, wherein the light division element is composed of a light modulation element that can be set to either a transmission state or a light-shielding state for each pixel, and a plurality of pixels corresponding to the plurality of transmission regions are set to the transmission state, and a plurality of pixels corresponding to the plurality of light-shielding regions are set to the light-shielding state.

[0013] According to an eighth aspect of the present invention, an aerial display device according to the fifth aspect is provided, wherein the position of the boundary between adjacent first element pixels and second element pixels is the same as the position of the center of the transparent region in the second direction.

[0014] According to a ninth aspect of the present invention, there is provided an aerial display device according to a fifth aspect, in which the total length in the second direction of adjacent first element pixels and second element pixels is the same as the total length in the second direction of adjacent transmission regions and light shielding regions.

[0015] According to a tenth aspect of the present invention, there is provided an aerial display device according to a first aspect, in which the first image and the second image are reversed in the up-and-down directions with respect to each other in the second direction.

[0016] According to an eleventh aspect of the present invention, there is provided an aerial display device according to a first aspect, in which each of the first image and the second image is a striped image.

[0017] According to a twelfth aspect of the present invention, there is provided an aerial display device according to a first aspect, in which the display element, the light splitting element, the light control element, and the optical element are arranged parallel to each other.

[0018] According to a thirteenth aspect of the present invention, there is provided an aerial display device according to a first aspect, further including a sensing element that senses an object present in a detection region formed to include a part of the aerial image, and a control unit that generates an image to be displayed on said display element based on the detection result of said sensing element.

[0019] According to a fourteenth aspect of the present invention, there is provided an aerial display device according to a second aspect, further including a first sensor that senses the movement of the first observer, a second sensor that senses the movement of the second observer, and a control unit that generates an image to be displayed on said display element based on the detection result of said first sensor and the detection result of said second sensor.

Advantages of the Invention

[0020] According to the present invention, it is possible to provide an aerial display device capable of displaying two different aerial images.

Brief Description of the Drawings

[0021] [Figure 1]Figure 1 is a perspective view of an aerial display device according to the first embodiment of the present invention. [Figure 2] Figure 2 is a schematic plan view of the display element shown in Figure 1. [Figure 3] Figure 3 is a perspective view of the optical splitting element shown in Figure 1. [Figure 4] Figure 4 is a side view of the YZ plane illustrating the dimensions of the optical splitting element. [Figure 5] Figure 5 is a perspective view of the optical control element shown in Figure 1. [Figure 6] Figure 6 is a perspective view of the optical element shown in Figure 1. [Figure 7] Figure 7 is a block diagram of the aerial display device. [Figure 8] Figure 8 is a side view of the aerial display device in the XZ plane. [Figure 9] Figure 9 is a perspective view illustrating the reflection of light in an optical element. [Figure 10] Figure 10 is a side view of the XZ plane illustrating the reflection of light in an optical element. [Figure 11] Figure 11 is a side view of the YZ plane illustrating the reflection of light in an optical element. [Figure 12] Figure 12 illustrates the angular conditions of the incident and reflective surfaces in an optical element. [Figure 13] Figure 13 is a ray tracing diagram of an aerial display device. [Figure 14] Figure 14 illustrates the operation of the display element and the optical splitting element. [Figure 15] Figure 15 illustrates the light distribution characteristics of the display element and the light splitting element. [Figure 16] Figure 16 is a plan view illustrating the image of the display element. [Figure 17] Figure 17 is a flowchart illustrating the display operation of the aerial display device. [Figure 18] Figure 18 is a schematic diagram illustrating the display operation of an aerial display device. [Figure 19] Figure 19 is a plan view illustrating a specific example of an image on a display element. [Figure 20] Figure 20 is a schematic plan view of a display element and an optical splitting element according to a second embodiment of the present invention. [Figure 21] Figure 21 is a block diagram of the aerial display device. [Figure 22] Figure 22 is a perspective view of an aerial display device according to a third embodiment of the present invention. [Figure 23] Figure 23 is a block diagram of the aerial display device. [Figure 24] Figure 24 illustrates the object detection operation of an aerial display device. [Figure 25] Figure 25 is a flowchart illustrating the display operation of the aerial display device. [Figure 26] Figure 26 is a schematic diagram illustrating the display operation of an aerial display device. [Figure 27] Figure 27 is a perspective view of an aerial display device according to a fourth embodiment of the present invention. [Modes for carrying out the invention]

[0022] The embodiments will be described below with reference to the drawings. However, the drawings are schematic or conceptual, and the dimensions and proportions in each drawing are not necessarily the same as those in reality. Furthermore, even when the same part is represented between drawings, the relationship between dimensions and proportions may be represented differently. In particular, the embodiments shown below are illustrative examples of devices and methods for realizing the technical concept of the present invention, and the technical concept of the present invention is not determined by the shape, structure, arrangement, etc. of the components. In the following description, elements having the same function and configuration are denoted by the same reference numerals, and redundant descriptions are omitted.

[0023] [1] First Embodiment [1-1] Configuration of the aerial display device 1 Figure 1 is a perspective view of an aerial display device 1 according to the first embodiment of the present invention. In Figure 1, the X direction is the direction along one side of the aerial display device 1, the Y direction is the direction perpendicular to the X direction in the horizontal plane, and the Z direction is the direction perpendicular to the XY plane (also called the normal direction).

[0024] The aerial display device 1 is a device that displays images (including video and moving images). The aerial display device 1 displays an aerial image in the air above its light-emitting surface. "Displaying an aerial image" is synonymous with "forming an aerial image." The light-emitting surface of the aerial display device 1 refers to the upper surface of the uppermost component among the multiple components that make up the aerial display device 1. An aerial image is a real image formed in the air.

[0025] The aerial display device 1 comprises a display element 10, an optical splitting element 20, an optical control element 30, and an optical element 40. The display element 10, the optical splitting element 20, the optical control element 30, and the optical element 40 are arranged in this order along the Z direction and are parallel to each other. The display element 10, the optical splitting element 20, the optical control element 30, and the optical element 40 are fixed in desired positions with fixing members (not shown) so as to maintain a desired distance from each other. The display element 10, the optical splitting element 20, the optical control element 30, and the optical element 40 are housed in a housing (not shown).

[0026] The display element 10 displays a desired image on its display surface. The image displayed by the display element 10 is also called a planar image. The display element 10 emits display light for displaying the image. The display element 10 is composed of, for example, a liquid crystal display element. The driving mode of the display element 10 is not particularly limited, and TN (Twisted Nematic) mode, VA (Vertical Alignment) mode, or homogeneous mode can be used.

[0027] The light-splitting element 20 has the function of splitting the light emitted from the display element 10 into multiple light components in the Y direction (i.e., when viewed from the X direction). The light-splitting element 20 splits the light emitted from the display element 10 into a first light component for displaying the first aerial image and a second light component for displaying the second aerial image. The area of ​​the light-splitting element 20 is set to be greater than or equal to the area of ​​the display element 10.

[0028] The light control element 30 has a function to reduce unwanted light. Unwanted light is light components that do not contribute to generating an aerial image and includes light components that are transmitted through the optical element 40 in the normal direction. The light control element 30 is configured to transmit light components within a predetermined angular range centered on an oblique direction with respect to the normal direction (angle θ3 described later) in the X direction (i.e., viewed from the Y direction), while blocking light components outside of the above angular range. The area of ​​the light control element 30 is set to be greater than or equal to the area of ​​the display element 10.

[0029] The optical element 40 reflects light incident from the bottom side to the top side. It also reflects incident light incident from the bottom side at an oblique angle to the normal direction perpendicular to the plane, for example, in the front direction (normal direction). The optical element 40 forms an aerial image in the air in front of the aerial display device 1. The aerial image is parallel to the element plane of the optical element 40 and is a two-dimensional image. The element plane refers to a virtual plane extending in the in-plane direction of the optical element 40. The term "element plane" has the same meaning as "in-plane." The same meaning applies to the element planes of other elements. An observer in front of the optical element 40 can see the aerial image. The area of ​​the optical element 40 is set to be greater than or equal to the area of ​​the display element 10.

[0030] [1-1-1] Configuration of display element 10 Figure 2 is a schematic plan view of the display element 10 shown in Figure 1.

[0031] The display element 10 comprises multiple elemental pixels EP, each extending in the X direction and aligned in the Y direction. Each of the multiple elemental pixels EP comprises multiple pixels PX arranged in a single row in the X direction. Each elemental pixel EP may be composed of two or more rows of pixels PX, each extending in the X direction. The number of rows of pixels PX constituting each elemental pixel EP is appropriately designed according to the size of the pixels PX.

[0032] Each of the multiple pixels PX is the smallest unit of color information in the image displayed by the display element 10. A pixel PX is composed of, for example, a red subpixel R, a green subpixel G, and a blue subpixel B, which correspond to the three primary colors of light: red (R), green (G), and blue (B). In Figure 2, three rows of pixel arrays are shown with red, green, and blue hatching. The same configuration applies to pixels in rows other than three.

[0033] Each of the red subpixels R, green subpixel G, and blue subpixel B has a rectangle whose longest side is the Y direction. The red subpixels R, green subpixel G, and blue subpixel B are arranged so as to be aligned in the X direction. The red subpixels R, green subpixel G, and blue subpixel B are configured to form a square as a whole.

[0034] For convenience, multiple element pixels EP are defined as the first element pixel EP_L on the left and the second element pixel EP_R on the right, arranged alternately along the Y direction. In Figure 2, the first element pixel EP_L and the second element pixel EP_R are distinguished by the direction of the hatching. Multiple first element pixels EP_L are arranged in a striped pattern as a whole. Multiple second element pixels EP_R are arranged in a striped pattern as a whole. The physical structure of the first element pixels EP_L and the second element pixels EP_R is the same. When the first element pixels EP_L and the second element pixels EP_R are not distinguished, they are referred to as element pixels EP. The left-right relationship of the element pixels EP is determined by their positional relationship with the optical division element 20, and the details will be described later.

[0035] [1-1-2] Configuration of the optical splitting element 20 Figure 3 is a perspective view of the optical splitting element 20 shown in Figure 1. Figure 3 also shows a magnified view of a portion of the optical splitting element 20.

[0036] The light-splitting element 20 comprises a transparent member 21 and a plurality of light-shielding layers 22.

[0037] The transparent member 21 is configured in a planar shape in the XY plane and has a rectangular parallelepiped. The transparent member 21 is made of a transparent material, such as glass or a transparent resin (including acrylic resin).

[0038] Multiple light-shielding layers 22 are provided on the transparent member 21. Each of the multiple light-shielding layers 22 extends in the X direction and is arranged in a line in the Y direction. The multiple light-shielding layers 22 have the same width and are arranged at equal intervals from one another. The multiple light-shielding layers 22 have the function of blocking light. The light-shielding layers 22 are made of, for example, a resin containing chromium (Cr), a chromium compound, or a black dye or pigment.

[0039] The light-splitting element 20 has a plurality of transparent regions 23 and a plurality of light-shielding regions 24. The plurality of transparent regions 23 and the plurality of light-shielding regions 24 each extend in the X direction and are arranged alternately along the Y direction. The transparent regions 23 correspond to areas where the light-shielding layer 22 is not provided, and the light-shielding regions 24 correspond to areas where the light-shielding layer 22 is provided. In other words, the plurality of transparent regions 23 are configured in a striped pattern as a whole. The plurality of light-shielding regions 24 are configured in a striped pattern as a whole.

[0040] Figure 4 is a side view of the YZ plane illustrating the dimensions of the optical splitting element 20. The optical splitting element 20 is mounted on the display element 10. Figure 4 shows an example where the optical splitting element 20 is positioned in contact with the display element 10.

[0041] As described above, the display element 10 comprises a plurality of first element pixels EP_L and a plurality of second element pixels EP_R arranged alternately. With respect to the center line of the transparent region 23, the element pixels on the left are first element pixels EP_L, and the element pixels on the right are second element pixels EP_R. In Figure 4, the first element pixels EP_L and the second element pixels EP_R are distinguished by the direction of the hatching. The boundary between the first element pixels EP_L and the second element pixels EP_R is set at the center line of the transparent region 23. Light emitted from the first element pixels EP_L is indicated by a solid arrow, and light emitted from the second element pixels EP_R is indicated by a dashed arrow.

[0042] The relationship between the length of the element pixel EP of the display element 10 and the lengths of the transparent region 23 and the light-shielding region 24 of the light-dividing element 20 is expressed by the following equation (1).

[0043] Bp = Bd + Bs = 2Dp ... (1) Dp: Length in the Y direction of element pixel EP Bs: Length in the Y direction of the transparent region 23 Bd: Length in the Y direction of the light-shielding area 24 Bp: Total length in the Y direction between the transparent region 23 and the light-shielding region 24 The length Dp of an element pixel EP in the Y direction is also called the pitch of the element pixel EP. The total length Bp of the transparent region 23 and the light-shielding region 24 in the Y direction is also called the pitch of the optical division element 20. The pitch of the optical division element 20 is the repeating unit of the same element, or in other words, the distance between the centerlines of the two transparent regions 23 that are arranged on either side of the light-shielding region 24.

[0044] From equation (1), once the length Dp of the element pixel EP is determined, the length Bp can be calculated. The optical splitting element 20 is configured such that the center line of the transmission region 23 passes through the boundary between the first element pixel EP_L and the second element pixel EP_R.

[0045] Furthermore, the total length in the Y direction of the transparent region 23 and the light-shielding region 24 does not need to perfectly match the total length in the Y direction of the first element pixel EP_L and the second element pixel EP_R, and manufacturing errors and misalignment errors are permitted in these length relationships.

[0046] The light emission angles of the elemental pixels EP and the optical splitting element 20 are expressed by the following equations (2) and (3). θ1 = sin -1 ((n² / n1)*sinθ²) ···(2) θ1'=sin -1 ((n² / n¹)*sinθ²´) ···(3) θ1: Emission angle of light emitted from the center of the first element pixel EP_L θ1': Emission angle of light emitted from the center of the second element pixel EP_R θ2: The emission angle when light from the first element pixel EP_L is emitted from the light splitting element 20. θ2': The emission angle when light from the second element pixel EP_R is emitted from the light splitting element 20. n1: Refractive index of the transparent member 21 of the light-dividing element 20 n2: Refractive index of the medium on the light-dividing element 20 In this embodiment, the refractive index n2 is set to air and its value is 1. The elemental pixel EP emits light radially from the normal direction. The arrows shown in Figure 4 schematically represent the light components that contribute to display from the light emitted from the elemental pixel EP. The arrows shown in Figure 4 represent the optical path at the center of the light component that contributes to display.

[0047] The exit angle θ2 is set to be between 10 degrees and 40 degrees. The exit angle θ2' is set to be between 10 degrees and 40 degrees. From equations (2) and (3) above, the angular ranges of the exit angles θ1 and θ1' are calculated.

[0048] Let Zb be the distance from the top surface (display surface) of the display element 10 to the light-shielding layer 22. When the distance Zb decreases, the emission angles θ2 and θ2' increase, and when the distance Zb increases, the emission angles θ2 and θ2' decrease. When the display element 10 and the light-dividing element 20 are placed in contact, the distance Zb corresponds to the thickness of the transparent member 21. When the display element 10 and the light-dividing element 20 are placed with a gap between them, the distance Zb corresponds to the sum of the thickness of the transparent member 21 and the distance between the display element 10 and the light-dividing element 20.

[0049] Figure 4 shows an example where the display element 10 and the optical splitting element 20 are in contact. However, if the display element 10 and the optical splitting element 20 are placed with a gap between them, the emission angle θ1 and emission angle θ1' are set considering the refraction angle at the bottom surface of the optical splitting element 20.

[0050] [1-1-3] Configuration of the light control element 30 Figure 5 is a perspective view of the optical control element 30 shown in Figure 1. Figure 5 also shows a partially enlarged view of the optical control element 30.

[0051] The light control element 30 comprises a plurality of transparent members 31 and a plurality of light-shielding members 32. Each of the plurality of transparent members 31 and the plurality of light-shielding members 32 extends in the Y direction. The plurality of transparent members 31 and the plurality of light-shielding members 32 are arranged alternately along the X direction such that adjacent members are in contact with each other.

[0052] The transparent member 31 extends in an oblique direction at an angle θ3 with respect to the normal direction (Z direction) in the XZ plane. The transparent member 31 is a parallelogram with its side surface inclined at an angle θ3 in the XZ plane. The transparent member 31 transmits light. Glass or a transparent resin (including acrylic resin) can be used as the transparent member 31.

[0053] The light-shielding member 32 extends in an oblique direction at an angle θ3 with respect to the normal direction in the XZ plane. The light-shielding member 32 is a parallelogram with its side surface inclined at an angle θ3 in the XZ plane. The light-shielding member 32 blocks light. The thickness of the light-shielding member 32 is set to be thinner than the thickness of the transparent member 31. For example, two adjacent light-shielding members 32 are arranged so that their ends slightly overlap in the Z direction. As the light-shielding member 32, for example, a resin mixed with black dye or pigment is used.

[0054] The multiple transparent members 31 and the multiple light-shielding members 32 may be provided on a rectangular transparent substrate.

[0055] The light control element 30 configured in this way can transmit display light such that the light intensity peaks in the oblique direction at an angle θ3 with respect to the normal direction. The light component transmitted through the transparent member 31 at an angle θ3 is emitted from the light control element 30 at an emission angle (refraction angle) θ4. For example, the light control element 30 is configured to block light components outside the range of 30°±30° with respect to the normal direction. Preferably, the light control element 30 is configured to block light components outside the range of 30°±20° with respect to the normal direction.

[0056] As a modified example, the aerial display device 1 may be configured by omitting the light control element 30.

[0057] [1-1-4] Configuration of the optical element 40 Figure 6 is a perspective view of the optical element 40 shown in Figure 1. Figure 6 also shows a magnified view of a portion of the optical element 40.

[0058] The optical element 40 comprises a substrate 41 and a plurality of optical elements 42. The substrate 41 is planar in the XY plane and has a rectangular parallelepiped.

[0059] Multiple optical elements 42 are provided on the bottom surface of the base material 41. Each of the multiple optical elements 42 is composed of a triangular prism. The optical elements 42 are arranged such that three sides of the triangular prism are parallel to the XY plane, and one side is in contact with the base material 41. Each of the multiple optical elements 42 extends in the Y direction and is arranged in a line in the X direction. In other words, the multiple optical elements 42 have a sawtooth shape in the XZ plane.

[0060] Each of the multiple optical elements 42 has an incident surface 43 and a reflecting surface 44. When viewed from the Y direction, the left side is the incident surface 43 and the right side is the reflecting surface 44. The incident surface 43 is the surface to which light from the display element 10 is incident. The reflecting surface 44 is the surface that reflects light incident on the incident surface 43 from the outside within the optical element 42. The angle between the incident surface 43 and the reflecting surface 44 is θ p It holds.

[0061] The base material 41 and the optical element 42 are made of a transparent material. The optical element 42 is formed integrally with the base material 41, for example, using the same transparent material as the base material 41. Alternatively, the base material 41 and the optical element 42 may be formed separately, and the optical element 42 may be bonded to the base material 41 using a transparent adhesive. As the transparent material constituting the base material 41 and the optical element 42, glass or a transparent resin (including acrylic resin) can be used.

[0062] The optical element 40 configured in this way reflects incident light internally to form a real image in the air. The optical element 40 also forms an aerial image at a position directly in front of the element surface.

[0063] [1-1-5] Block configuration of the aerial display device 1 Figure 7 is a block diagram of the aerial display device 1. The aerial display device 1 comprises a control unit 50, a storage unit 51, an input / output interface (input / output IF) 52, a display element 10, and an input unit 53. The control unit 50, the storage unit 51, and the input / output interface 52 are connected to each other via a bus 54.

[0064] The input / output interface 52 is connected to the display element 10 and the input unit 53. The input / output interface 52 performs interface processing for each of the display element 10 and the input unit 53 according to a predetermined standard. The display element 10 displays an image on its display surface.

[0065] The control unit 50 is composed of one or more processors, such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The control unit 50 implements various functions by executing programs stored in the memory unit 51. The control unit 50 includes a display processing unit 50A and an image processing unit 50B.

[0066] The display processing unit 50A controls the operation of the display element 10. The display processing unit 50A transmits an image signal to the display element 10 and causes the display element 10 to display an image.

[0067] The image processing unit 50B generates an image to be displayed by the aerial display device 1. The image processing unit 50B can use image data stored in the storage unit 51. The image processing unit 50B may also acquire image data from an external source using a communication function (not shown).

[0068] The storage unit 51 includes non-volatile storage devices such as ROM (Read Only Memory), HDD (Hard Disk Drive), and SSD (Solid State Drive), and volatile storage devices such as RAM (Random Access Memory) and registers. The storage unit 51 stores the program executed by the control unit 50. The storage unit 51 stores various data necessary for controlling the control unit 50. The storage unit 51 stores the image data displayed by the aerial display device 1.

[0069] The input unit 53 includes a touch panel and buttons, and receives information entered by the user. The image processing unit 50B can select an image to display on the display element 10 based on the information received by the input unit 53.

[0070] [1-2] Operation Next, the operation of the aerial display device 1 configured as described above will be explained.

[0071] [1-2-1] Basic operation of the aerial display device 1 First, the basic operation of the aerial display device 1 will be explained. Figure 8 is a side view of the aerial display device 1 in the XZ plane. The arrows in Figure 8 represent the approximate optical path. In Figure 8, for simplicity, the refraction angle of the components is not considered. The basic operation described here is the operation when the aerial display device 1 is viewed from the Y direction. Note that the display operation described later (the operation in which two observers view two aerial images) is the operation when the aerial display device is viewed from the X direction.

[0072] The display element 10 emits light radially from any point on its screen, due to the image. The light emitted from any point on the display element 10 passes through the light division element 20 and then enters the light control element 30. Of the light emitted from the display element 10, the light component at angle θ3 (including the light component within a predetermined angular range centered on angle θ3) passes through the light control element 30. The obliquely oriented light that has passed through the light control element 30 enters the optical element 40. The optical element 40 reflects the incident light to the opposite side of the light control element 30, forming an aerial image 2 in the air. The aerial image 2 is a two-dimensional image parallel to the display element 10.

[0073] Figure 9 is a perspective view illustrating the reflection of light in the optical element 40. Figure 10 is a side view of the XZ plane illustrating the reflection of light in the optical element 40. Figure 10 shows the optical element 40 as seen by observer 3 with both eyes (i.e., the line connecting both eyes) parallel to the X direction. Figure 11 is a side view of the YZ plane illustrating the reflection of light in the optical element 40. Figure 11 shows the optical element 40 as seen by observer 3 with both eyes parallel to the Y direction.

[0074] Light emitted from any point "o" of the optical control element 30 enters the incident surface 43 of the optical element 40 and reaches the reflection surface 44. Light that reaches the reflection surface 44 at an angle greater than the critical angle with respect to the normal direction of the reflection surface 44 is totally reflected by the reflection surface 44 and is emitted from the plane opposite to the side of the optical element 42 of the optical element 40. The critical angle is the smallest angle of incidence beyond which total reflection occurs. The critical angle is the angle with respect to the perpendicular to the incident surface.

[0075] In the XZ plane of Figure 10, the light component of the light emitted from point "o" that contributes to the display is totally reflected by the reflective surface 44 of the optical element 42, and this light is imaged in the air to generate an aerial image.

[0076] In the YZ plane of Figure 11, the light component of the light emitted from point "o" that does not contribute to the display is not reflected by the reflective surface 44 of the optical element 42, and since this light does not form an image in the air, it does not contribute to the generation of an aerial image.

[0077] That is, the condition for the observer 3 to visually recognize the aerial image is that both eyes of the observer 3 are parallel to the X direction or in a state close thereto (for example, within ±10 degrees with respect to the X direction). Further, when the observer 3 moves the viewpoint along the Y direction in a state where both eyes are parallel to the X direction or close thereto, the observer 3 can always recognize the aerial image.

[0078] FIG. 12 is a diagram for explaining the angular conditions of the incident surface 43 and the reflection surface 44 in the optical element 40.

[0079] Let the angle of the incident surface 43 with respect to the Z direction (the direction perpendicular to the element surface) be θ5, the angle of the reflection surface 44 with respect to the Z direction be θ6, and the angle formed by the incident surface 43 and the reflection surface 44 be θ p be. The angle θ p is expressed by the following formula (4). θ p = θ5 + θ6 ··· (4)

[0080] The light emitted from the light control element 30 at an angle θ4 is incident on the incident surface 43. Let the refractive index of the material of the optical element 40 be n p , and the refractive index of air be 1. Let the incident angle on the incident surface 43 be θ7 and the refractive angle be θ8. Let the incident angle on the reflection surface 44 be θ9 and the reflection angle be θ 10 (= θ9). Let the incident angle on the upper surface of the optical element 40 be θ 11 , and the refractive angle be θ 12 . The refractive angle θ 12 is the emission angle. The emission angle θ 12 is expressed by the following formula (5). θ 12 = sin -1 (n p * sin (sin -1 ((1 / n p ) * sin (90° - (θ4 + θ5)) + θ5 + 2θ6 - 90°)) ··· (5)

[0081] The critical angle on the reflection surface 44 is expressed by the following formula (6). Critical angle < θ9 (= θ 10 ) Critical angle = sin -1 (1 / n p ) ··· (6)

[0082] In other words, the angle of incidence θ9 at the reflective surface 44 is set to be greater than the critical angle at the reflective surface 44. To put it another way, the angle θ6 of the reflective surface 44 is set so that the angle of incidence of light incident on the reflective surface 44 is greater than the critical angle.

[0083] Furthermore, the light incident on the incident surface 43 is set so that it is not totally reflected at the incident surface 43. In other words, the angle θ5 of the incident surface 43 is set so that the angle of incidence of the light incident on the incident surface 43 is smaller than the critical angle.

[0084] The angle between the element surface of the optical element 40 and the plane of the aerial image 2, and the distance between the element surface of the optical element 40 and the plane of the aerial image 2, can be adjusted by optimally setting the angle θ7 of the light incident on the optical element 40, the refractive index of the optical element 40, the angle θ5 of the incident surface 43 of the optical element 40, and the angle θ6 of the reflective surface 44 of the optical element 40.

[0085] Figure 13 is a ray tracing diagram of the aerial display device 1. Figure 13 is a side view of the aerial display device 1 in the XZ plane. Light components are emitted from an arbitrary point "o" on the optical control element 30 in the direction diagonally to the right in the figure. Light that is obliquely incident from the optical control element 30 to the optical element 40 is reflected in the direction forward by the optical element 40. The light reflected by the optical element 40 is then imaged at point "o'". The position of point "o'" is the position where the aerial image 2 is displayed.

[0086] [1-2-2] Display operation Next, the display operation of the aerial display device 1 will be described.

[0087] Figure 14 illustrates the operation of the display element 10 and the optical splitting element 20. Figure 14 shows side views of the display element 10 and the optical splitting element 20 in the YZ plane, and a plan view of a part of the display element 10.

[0088] Of the light emitted radially from the first element pixel EP_L, the light component traveling diagonally to the right passes through the transmission region 23. Of the light emitted from the first element pixel EP_L, the light components traveling in the normal direction and diagonally to the left of that direction are blocked by the light-shielding layer 22.

[0089] Of the light emitted radially from the second element pixel EP_R, the light component traveling in the diagonal direction to the left passes through the transmission region 23. Of the light emitted from the second element pixel EP_R, the light components traveling in the normal direction and in the diagonal direction to the right are blocked by the light-shielding layer 22.

[0090] Thus, the light splitting element 20 can emit light from multiple first element pixels EP_L in a diagonal direction to the right, and emit light from multiple second element pixels EP_R in a diagonal direction to the left. Furthermore, the light splitting element 20 can split the light emitted from multiple first element pixels EP_L and the light emitted from multiple second element pixels EP_R.

[0091] Figure 15 illustrates the light distribution characteristics of the display element 10 and the light splitting element 20. The horizontal axis of Figure 15 represents the angle (degrees) at which an observer views the light splitting element 20 along the Y direction, and the vertical axis represents the light output ratio (%). An angle of 0 degrees corresponds to viewing the light splitting element 20 from the normal direction (front). The solid line graph in Figure 15 represents the light emitted from the first element pixel EP_L, and the dashed line graph represents the light emitted from the second element pixel EP_R.

[0092] As can be seen from Figure 15, the light splitting element 20 is able to split the light emitted from the first element pixel EP_L and the light emitted from the second element pixel EP_R, depending on the viewing angle of the light splitting element 20. The light splitting element 20 can emit the light component of the light emitted from the first element pixel EP_L that peaks at an angle of around 30 degrees. In addition, the light splitting element 20 can emit the light component of the light emitted from the second element pixel EP_R that peaks at an angle of around -30 degrees.

[0093] Figure 16 is a plan view illustrating the image of the display element 10. The display element 10 displays a first image 11-1 and a second image 11-2. The first image 11-1 is an image displayed by a plurality of first element pixels EP_L. The second image 11-2 is an image displayed by a plurality of second element pixels EP_R. In Figure 16, each of the lines extending in the X direction represents an image displayed by a single element pixel EP. The first image 11-1 is positioned relatively to the left, and the second image 11-2 is positioned relatively to the right.

[0094] Image 11-1 and Image 21-2 are each striped images consisting of multiple parallel lines. Image 11-1 and Image 21-2 are different images. Here, "different images" means images that are imaged by different display lights. The image contents of Image 11-1 and Image 21-2 may be different or the same. In Figure 16, Image 11-1 and Image 21-2 are simply shown with hatching, but in reality, each is an arbitrary image with its own content.

[0095] The image processing unit 50B generates image data corresponding to two types of images observed by different observers, namely the first image 11-1 and the second image 11-2. The display processing unit 50A uses the two types of image data generated by the image processing unit 50B to display the first image 11-1 and the second image 11-2 on the display element 10.

[0096] Figure 17 is a flowchart illustrating the display operation of the aerial display device 1. Figure 18 is a schematic diagram illustrating the display operation of the aerial display device 1. Figure 18 is a side view of the aerial display device 1 in the YZ plane.

[0097] The aerial display device 1 is observed by two observers facing each other in the Y direction, namely, the first observer 3-1 and the second observer 3-2. The first observer 3-1 is positioned to the right of the aerial display device 1 in the Y direction and observes the aerial image from the right. The second observer 3-2 is positioned to the left of the aerial display device 1 in the Y direction and observes the aerial image from the left. The orientation in which the first observer 3-1 and the second observer 3-2 view the aerial display device 1 is inverted vertically in the Y direction.

[0098] The image processing unit 50B generates first image data for the first image 11-1 and second image data for the second image 11-2 (step S100). Specifically, the image processing unit 50B generates first image data for the first image 11-1 and second image data for the second image 11-2 such that their vertical orientations are reversed in the Y direction.

[0099] Next, the display processing unit 50A displays the first image 11-1 and the second image 11-2 on the display element 10 based on the first image data and the second image data (step S101). The light splitting element 20 splits the first light component 12-1 of the first image 11-1 and the second light component 12-2 of the second image 11-2 in the Y direction. When viewed in the YZ plane, the light splitting element 20 emits the first light component 12-1 diagonally upward to the right and the second light component 12-2 diagonally upward to the left.

[0100] The optical control element 30 receives the first optical component 12-1 and the second optical component 12-2 from the optical division element 20. When viewed in the XZ plane, the optical control element 30 emits the optical component from the optical division element 20 that contributes to the display (the optical component directed diagonally upward to the right). The optical element 40 reflects the light from the optical control element 30 to the opposite side of the optical control element 30, and forms the first aerial image 2-1 and the second aerial image 2-2 at a desired position in the air.

[0101] The first observer 3-1 views the first aerial image 2-1 based on the first light component 12-1. The second observer 3-2 views the second aerial image 2-2 based on the second light component 12-2. The first aerial image 2-1 and the second aerial image 2-2 are different images. The image processing unit 50B generates first image data related to the first aerial image 2-1 so that the vertical direction of the first observer 3-1 matches the vertical direction of the aerial image. The image processing unit 50B generates second image data related to the second aerial image 2-2 so that the vertical direction of the second observer 3-2 matches the vertical direction of the aerial image.

[0102] Figure 19 is a plan view illustrating a specific example of the image displayed by the display element 10. The image is an example of an ace in a deck of cards. The image on the card is in color, for example, red. The dot hatching around the card represents black.

[0103] The display element 10 displays a first image 11-1 and a second image 11-2. Each of the first image 11-1 and the second image 11-2 is an image of a single ace playing card. Each of the first image 11-1 and the second image 11-2 is a striped image. The first image 11-1 is positioned relatively to the left in the Y direction, and the second image 11-2 is positioned relatively to the right in the Y direction. The first image 11-1 and the second image 11-2 are positioned to partially overlap.

[0104] The image processing unit 50B generates first image data for the first image 11-1 and second image data for the second image 11-2. The display processing unit 50A uses the two types of image data generated by the image processing unit 50B to display the first image 11-1 and the second image 11-2 on the display element 10. The first observer 3-1 and the second observer 3-2, facing each other across the aerial display device 1 in the Y direction, each view an aerial image of a single ace playing card.

[0105] [1-3] Effects of the first embodiment According to the first embodiment, the aerial display device 1 can display two different aerial images (specifically, two aerial images with different image content). A first observer 3-1 and a second observer 3-2, facing each other with the aerial display device 1 in the Y direction, can each view different aerial images. Furthermore, each of the first observer 3-1 and the second observer 3-2 can view the aerial image in such a way that their own vertical direction aligns with the vertical direction of the aerial image.

[0106] Furthermore, even when two observers view the same aerial image, they do not need to view it from the same side of the aerial display device 1. Instead, the two observers can face each other with the aerial display device 1 in between, each able to view the optimal aerial image.

[0107] Furthermore, light components that do not contribute to the display of the aerial image can be blocked by the light control element 30. This improves the display quality of the aerial image.

[0108] Furthermore, it is possible to display a two-dimensional aerial image parallel to the display element 10. In addition, multiple elements constituting the aerial display device 1 can be arranged in parallel. This makes it possible to realize an aerial display device 1 that can be miniaturized in the Z direction.

[0109] [2] Second embodiment In the second embodiment, the optical splitting element 20 is composed of an optical modulation element that can partially block light, and the lengths of the light-transmitting region 23 and the light-blocking region 24 of the optical splitting element 20 in the Y direction are made variable.

[0110] Figure 20 is a schematic plan view of the display element 10 and the light division element 20 according to the second embodiment of the present invention.

[0111] The configuration of the display element 10 is the same as in the first embodiment. The display element 10 comprises a plurality of first element pixels EP_L and a plurality of second element pixels EP_R arranged alternately along the Y direction.

[0112] The light-splitting element 20 is composed of a light-modulating element capable of electrically modulating light (setting to a transmission state and a light-blocking state). The light-splitting element 20 is composed of a transmissive liquid crystal display element capable of displaying in black and white, or an electrochromic display element. The liquid crystal display element may be a passive matrix type or an active matrix type. In the liquid crystal display element, white display corresponds to the transmission state, and black display corresponds to the light-blocking state. An electrochromic display element is a display element capable of changing light transmittance by electrochemically oxidizing and reducing an electrochromic material.

[0113] The optical splitting element 20 comprises a plurality of pixels arranged in a matrix. Each pixel is, for example, square. Each pixel may be configured as a line extending in the X direction. The length of each pixel in the Y direction is set to be sufficiently small compared to the length of the element pixel EP in the Y direction.

[0114] The optical splitting element 20 comprises a plurality of transparent regions 23 and a plurality of light-shielding regions 24 arranged alternately along the Y direction. Each of the plurality of transparent regions 23 extends in the X direction. One transparent region 23 is composed of multiple pixels. Each of the plurality of light-shielding regions 24 extends in the X direction. One light-shielding region 24 is composed of multiple pixels. When calculating the dimensions of the transparent regions 23 and light-shielding regions 24 of the optical splitting element 20 using the formula described above, for example, it is calculated assuming that the light-shielding layer 22 is at the center in the normal direction of the optical splitting element 20.

[0115] Figure 21 is a block diagram of the aerial display device 1. The aerial display device 1 includes an electrically controllable optical splitting element 20. The control unit 50 includes a region setting unit 50C.

[0116] The optical splitting element 20 is connected to the input / output interface 52. The input / output interface 52 performs interface processing on the optical splitting element 20 according to a predetermined standard.

[0117] The region setting unit 50C controls the operation of the optical division element 20. The region setting unit 50C sets each of the multiple pixels included in the optical division element 20 to either a transmission state or a light-shielding state. The region setting unit 50C changes the length in the Y direction of the transmission region 23 and the length in the Y direction of the light-shielding region 24 in the optical division element 20, and sets the length in the Y direction of the transmission region 23 and the length in the Y direction of the light-shielding region 24 to a desired length. The region setting unit 50C sets the length in the Y direction of the transmission region 23 and the length in the Y direction of the light-shielding region 24 based on information from the outside.

[0118] The aerial display device 1 configured as described above can adjust the positions of the first aerial image 2-1 and the second aerial image 2-2 according to the positions of the first observer 3-1 and the second observer 3-2.

[0119] [3] Third embodiment In the third embodiment, the aerial display device 1 is configured so that two observers facing each other with their fingers or other means can manipulate the aerial image.

[0120] [3-1] Configuration of the aerial display device 1 Figure 22 is a perspective view of an aerial display device 1 according to a third embodiment of the present invention. The aerial display device 1 includes a sensing element 60, a first sensor 70-1, and a second sensor 70-2.

[0121] The sensing element 60 is positioned, for example, at the end of the optical element 40 in the X direction and above the optical element 40. The sensing element 60 may be positioned separately from the housing of the aerial display device 1. The sensing element 60 has the function of detecting objects in the spatial region where the aerial image is displayed. The sensing element 60 is composed of, for example, a two-dimensional TOF (time of light) sensor.

[0122] The sensing element 60 forms a detection area in a spatial region that includes part or all of the aerial image generated by the aerial display device 1. The sensing element 60 detects objects present in the detection area. The sensing element 60 emits light (e.g., infrared light) into the detection area and detects the reflected light reflected by the object. The sensing element 60 includes a light-emitting unit that emits infrared light toward the detection area and a light-receiving unit that detects the reflected light reflected by the object. The sensing element 60 comprises, for example, a plurality of light-emitting elements and a plurality of light-receiving elements, and the plurality of light-emitting elements and the plurality of light-receiving elements are arranged alternately in a line. The sensing element 60 can scan space in a line using infrared light and can scan a two-dimensional space consisting of the direction in which the plurality of light-emitting elements are arranged and the direction in which the light travels. The direction of the infrared light emitted by the sensing element 60 can be set as appropriate; for example, it may be configured to emit infrared light diagonally upward so that the infrared light intersects the aerial image at an angle.

[0123] The first sensor 70-1 is positioned at one end of the optical element 40 in the Y direction and above the optical element 40. The second sensor 70-2 is positioned at the other end of the optical element 40 in the Y direction and above the optical element 40. The first sensor 70-1 and the second sensor 70-2 are positioned, for example, on the upper part of the housing of the aerial display device 1. The length of the first sensor 70-1 and the second sensor 70-2 in the X direction is, for example, approximately the same as the length of the optical element 40 in the X direction.

[0124] The first sensor 70-1 and the second sensor 70-2 are non-contact sensors, for example, pyroelectric sensors. The first sensor 70-1 and the second sensor 70-2 detect objects above themselves. Specifically, the first sensor 70-1 detects the movement of the first observer 3-1 and whether or not the first observer 3-1 manipulates the aerial image. The second sensor 70-2 detects the movement of the second observer 3-2 and whether or not the second observer 3-2 manipulates the aerial image.

[0125] Figure 23 is a block diagram of the aerial display device 1. The aerial display device 1 includes a sensing element 60, a first sensor 70-1, and a second sensor 70-2. The sensing element 60, the first sensor 70-1, and the second sensor 70-2 are connected to an input / output interface 52. The input / output interface 52 performs interface processing on the sensing element 60, the first sensor 70-1, and the second sensor 70-2 according to a predetermined standard.

[0126] The control unit 50 includes a detection position calculation unit 50D. The detection position calculation unit 50D controls the operation of the sensing element 60. The detection position calculation unit 50D receives a detection signal as a detection result from the sensing element 60. Based on the detection signal, the detection position calculation unit 50D calculates the position of the object.

[0127] The image processing unit 50B receives detection signals as detection results from the first sensor 70-1 and the second sensor 70-2. Based on the detection signals from the first sensor 70-1 and the second sensor 70-2, the image processing unit 50B determines whether the first observer 3-1 or the second observer 3-2 manipulated the aerial image. Based on the determination result and the calculation result of the detection position calculation unit 50D, the image processing unit 50B generates image data to be displayed as an aerial image.

[0128] [3-2] Operation Next, the operation of the aerial display device 1 configured as described above will be explained.

[0129] Figure 24 illustrates the object detection operation of the aerial display device 1. Figure 24 is a side view of the aerial display device 1 in the XZ plane.

[0130] The aerial display device 1 displays a first aerial image 2-1 and a second aerial image 2-2 in the air. The sensing element 60 forms a detection region 61 in a spatial area that includes part or all of the first aerial image 2-1 and the second aerial image 2-2. Alternatively, the sensing element 60 forms a detection region 61 that diagonally intersects the first aerial image 2-1 and the second aerial image 2-2. The detection region 61 is a two-dimensional region consisting of infrared light. The sensing element 60 detects objects present in the detection region 61. The detection position calculation unit 50D calculates the position of the object based on the detection signal from the sensing element 60.

[0131] Figure 25 is a flowchart illustrating the display operation of the aerial display device 1. Figure 26 is a schematic diagram illustrating the display operation of the aerial display device 1. Figure 26 is a side view of the aerial display device 1 in the YZ plane. In Figure 26, the aerial image is an example of a board game (Reversi). The first observer 3-1 and the second observer 3-2 are positioned facing each other in the Y direction, with the aerial display device 1 in between.

[0132] The image processing unit 50B generates first image data for the first image 11-1 and second image data for the second image 11-2 (step S200). The display processing unit 50A causes the display element 10 to display the first image 11-1 and the second image 11-2 based on the first image data and the second image data (step S201). The optical element 40 displays the first aerial image 2-1 and the second aerial image 2-2 in the air. The first aerial image 2-1 and the second aerial image 2-2 are the same image as seen by the first observer 3-1 and the second observer 3-2, respectively.

[0133] The first sensor 70-1 and the second sensor 70-2 monitor the observer's actions (step S202). The first sensor 70-1 can detect the hand or arm of the first observer 3-1. The second sensor 70-2 can detect the hand or arm of the second observer 3-2.

[0134] The first observer 3-1 and the second observer 3-2 each manipulate the pieces in the first aerial image 2-1 and the second aerial image 2-2, respectively. During this process, a move made by either the first aerial image 2-1 or the second aerial image 2-2 is detected by either the first sensor 70-1 or the second sensor 70-2. In the example shown in Figure 26, the move made by the first observer 3-1 is detected by the first sensor 70-1.

[0135] The image processing unit 50B determines the observer who manipulated the aerial image (either the first observer 3-1 or the second observer 3-2) based on the detection signals from the first sensor 70-1 and the second sensor 70-2 (step S203).

[0136] Next, the sensing element 60 detects an object in the detection area 61, namely the observer's finger. The detection position calculation unit 50D calculates the position of the object in the detection area 61 based on the detection signal from the sensing element 60 (step S204). Specifically, the detection position calculation unit 50D calculates the position indicated by the observer's finger.

[0137] The image processing unit 50B updates the first image data for the first image 11-1 and the second image data for the second image 11-2 based on the determination result in step S203 and the calculation result in step S204 (step S205). In the example in Figure 26, the image processing unit 50B generates the first and second image data showing the placement of pieces in the squares indicated by the first observer 3-1. The image processing unit 50B also generates the first and second image data in accordance with the rules of the board game.

[0138] Then, the display processing unit 50A displays the first image 11-1 and the second image 11-2 on the display element 10 based on the updated first image data and second image data. At this time, since the positions of the first aerial image 2-1 and the second aerial image 2-2 seen by the first observer 3-1 and the second observer 3-2 are aligned, the position of the mass is seen as the same position by each observer.

[0139] [3-3] Effects of the third embodiment According to the third embodiment, a first observer 3-1 and a second observer 3-2, facing each other in the Y direction with the aerial display device 1 in between, can manipulate the aerial image displayed on the same plane.

[0140] Furthermore, it is possible to determine which observer manipulated the aerial image. This allows the first aerial image 2-1 and the second aerial image 2-2 to be displayed, updated with the information provided by the observer.

[0141] Furthermore, when an observer manipulates the aerial image with their finger, the position of the finger can be calculated. This allows for the display of an aerial image optimized for the observer's manipulation.

[0142] [4] Fourth Embodiment The fourth embodiment configures the aerial display device 1 so that it can display an aerial image above a decorative member having a pattern.

[0143] Figure 27 is a perspective view of an aerial display device 1 according to a fourth embodiment of the present invention. The aerial display device 1 includes a decorative member 71.

[0144] The decorative member 71 is provided above the optical element 40. The decorative member 71 may be positioned so as to be in contact with the upper surface of the optical element 40. The decorative member 71 is a transparent sheet-like member. The decorative member 71 has a pattern. The decorative member 71 is formed, for example, by printing on a transparent film. For example, the pattern of the decorative member 71 is a board game pattern (grid).

[0145] Taking the example of a board game as the aerial image, the aerial display device 1 displays only the game pieces as the aerial image. The observer sees the pattern on the decorative member 71 and the game pieces floating above the decorative member 71. This makes it possible to achieve a display with a sense of depth and high visibility.

[0146] [5] Variant In each of the above embodiments, the display element 10 and the optical element 40 are arranged in parallel. However, the invention is not limited to this, and the display element 10 may be arranged diagonally with respect to the optical element 40. The angle between the display element 10 and the optical element 40 is set to a range greater than 0 degrees and less than 45 degrees. In this modified example, the light control element 30 can be omitted.

[0147] In each of the embodiments described above, the left side of the optical element 42 is defined as the incident surface 43, and the right side is defined as the reflective surface 44. However, the invention is not limited to this, and the incident surface 43 and the reflective surface 44 may be configured in reverse. In this case, the operation of the aerial display device 1 described in the embodiments will also be reversed left and right.

[0148] In the embodiments described above, a liquid crystal display element is used as an example for the display element 10, but it is not limited to this, and various types of display elements can be used. For example, the display element 10 can be a self-emissive organic EL (electroluminescence) display element or a micro-LED (light-emitting diode) display element. A micro-LED display element is a display element that emits R (red), G (green), and B (blue) light, which constitute the pixels, using LEDs.

[0149] The present invention is not limited to the embodiments described above, and can be modified in various ways during implementation without departing from its essence. Furthermore, each embodiment may be combined as appropriate, and in that case, the combined effects can be obtained. Moreover, the above embodiments include various inventions, and various inventions can be extracted by selecting combinations from the multiple constituent elements disclosed. For example, if the problem can be solved and effects obtained even if some constituent elements are deleted from all the constituent elements shown in the embodiment, then the configuration with these deleted constituent elements can be extracted as an invention. [Explanation of Symbols]

[0150] 1...Aerial display device, 2...Aerial image, 3...Observer, 10...Display element, 20...Light division element, 21...Transparent member, 22...Light-shielding layer, 23...Transmitting area, 24...Light-shielding area, 30...Light control element, 31...Transparent member, 32...Light-shielding member, 40...Optical element, 41...Substrate, 42...Optical element, 43...Incident surface, 44...Reflective surface, 50...Control unit, 50A...Display processing unit, 50B...Image processing unit, 50C...Area setting unit, 50D...Detection position calculation unit, 51...Storage unit, 52...Input / output interface, 53...Input unit, 54...Bus, 60...Sensing element, 70-1...First sensor, 70-2...Second sensor, 71...Decorative member.

Claims

1. A display element having a plurality of first element pixels and a plurality of second element pixels, wherein each of the plurality of first element pixels extends in a first direction and is arranged in a second direction perpendicular to the first direction, each of the plurality of second element pixels extends in the first direction and is arranged in the second direction, the plurality of first element pixels and the plurality of second element pixels are arranged alternately, the plurality of first element pixels display a first image, and the plurality of second element pixels display a second image, An optical splitting element is positioned to receive light from the display element, and, when viewed from the first direction, emits light from the plurality of first element pixels in a diagonal direction to the right, and emits light from the plurality of second element pixels in a diagonal direction to the left. An optical control element is positioned to receive light from the optical splitting element and, when viewed from the second direction, transmits the oblique optical component of the light from the optical splitting element, An optical element is positioned to receive light from the aforementioned optical control element, and reflects the light emitted from the optical control element to the opposite side of the optical control element, thereby forming an aerial image in the air. An aerial display device equipped with the following.

2. The optical element forms a first aerial image based on the first image, and forms a second aerial image based on the second image. The first aerial image is visible to a first observer who is on the right side when viewed from the first direction. The second aerial image is visible to a second observer who is on the left side when viewed from the first direction. The aerial display device according to claim 1.

3. The optical element includes a planar substrate and a plurality of optical elements provided beneath the substrate, each extending in the second direction and arranged in the first direction. Each of the plurality of optical elements is inclined with respect to the normal direction of the substrate and has an incident surface and a reflective surface that are in contact with each other. The aerial display device according to claim 1.

4. The light control element includes a plurality of transparent members and a plurality of light-shielding members, Each of the plurality of transparent members extends in the second direction and is arranged in the first direction. Each of the aforementioned plurality of light-shielding members extends in the second direction and is arranged in the first direction. The plurality of transparent members and the plurality of light-shielding members are arranged alternately. The plurality of light-shielding members are inclined with respect to the normal of the light control element. The aerial display device according to claim 1.

5. The aforementioned light splitting element has a plurality of transmission regions and a plurality of light-shielding regions, Each of the plurality of transparent regions extends in the first direction and is aligned in the second direction. Each of the aforementioned multiple light-shielding regions extends in the first direction and is arranged in the second direction. The plurality of transparent regions and the plurality of light-shielding regions are arranged alternately. The aerial display device according to claim 1.

6. The light-splitting element includes a planar transparent member and a plurality of light-shielding layers provided on the transparent member. Each of the aforementioned light-shielding layers extends in the first direction and is arranged at intervals in the second direction. Each of the aforementioned light-shielding layers is arranged in the aforementioned light-shielding regions. The aerial display device according to claim 5.

7. The aforementioned light-dividing element is composed of a light-modulating element that can be set to either a transmission state or a light-blocking state for each pixel. Multiple pixels corresponding to the multiple transparent regions are set to a transparent state. Multiple pixels corresponding to the multiple light-shielding regions are set to a light-shielding state. The aerial display device according to claim 5.

8. The position of the boundary between adjacent first and second element pixels is the same as the position of the center of the transparent region in the second direction. The aerial display device according to claim 5.

9. The sum of the lengths of adjacent first and second element pixels in the second direction is the same as the sum of the lengths of adjacent transparent and light-shielding regions in the second direction. The aerial display device according to claim 5.

10. The first and second images are in opposite orientations in the second direction. The aerial display device according to claim 1.

11. The first image and the second image are each striped images. The aerial display device according to claim 1.

12. The display element, the light splitting element, the light control element, and the optical element are arranged parallel to each other. The aerial display device according to claim 1.

13. A sensing element that detects an object located in a detection region formed to include a part of the aerial image, A control unit that generates an image to be displayed on the display element based on the detection result of the sensing element, It further comprises The aerial display device according to claim 1.

14. A first sensor that detects the movement of the first observer, A second sensor that detects the movement of the second observer, A control unit that generates an image to be displayed on the display element based on the detection result of the first sensor and the detection result of the second sensor, It further comprises The aerial display device according to claim 2.

Images