Aerial video display device

Abstract

[Problem] To provide an aerial video display device that makes it possible to produce a concave curved aerial display.　An aerial video display device according to the present invention comprises a display device, a control device that outputs a video signal to the display device, and an optical plate that is held so as to face a display screen of the display device at a prescribed angle. When video is displayed by the display device, the video is formed as aerial video at a symmetric position on the opposite side from the optical plate. The display screen of the display device is convex. This aerial video display device is to be employed, for example, as a video display device for a control simulator that simulates a cockpit.

Description

Aerial image display device

[0001] The present invention relates to an aerial image display device capable of displaying a concave curved aerial image.

[0002] Interest in aerial video displays has been growing in recent years. One factor behind this is the need for contactless solutions amid the COVID-19 pandemic. Specifically, they are being used in combination with sensors to replace touch panels. For example, at bank ATMs, supermarket self-checkouts, corporate reception desks, and hotel check-ins, an unspecified number of users operate the same touch panel. These touch panels can potentially become a route for infection. To avoid this risk, touch panels need to be disinfected every time a user changes, but such a process is quite time-consuming and difficult to carry out adequately.

[0003] A contactless interface using an aerial image display device can be used with the same ease as a conventional touch panel, without the need for such hassle, and can avoid the risk of infection. For example, in Patent Document 1, since touching a pointing device such as a computer mouse during surgery is a hygiene issue, the surgeon operates a mouse on a contactless remote pointer control device displayed using aerial imaging technology. An example of a special optical element that can be used with such aerial imaging technology is the optical imaging device described in Patent Document 2.

[0004] The way aerial imaging technology allows images to float in empty space is impactful in itself and helps create a futuristic atmosphere. For this reason, many applications beyond infection prevention measures are conceivable. For example, applying it to digital signage can make it more eye-catching. The technology disclosed in Patent Document 3 shows an example of its use as a replacement for barriers at train station ticket gates. Furthermore, when displayed as an aerial image, it appears to float above its surroundings, creating a sense of three-dimensionality that is highly entertaining, and potential applications for games and other applications are anticipated.

[0005] JP 2018-147054 A International Publication No. 2009 / 131128 A JP 2017-142370 A

[0006] Although it is true that aerial images appear to float in the air, conventional aerial image display devices are essentially flat displays. In other words, the screen appears to float in the air, but the aerial screen itself is flat. As a result, especially with large screens, the left and right edges of the display are far from the eyes and difficult to see, and the image is distorted at the edges, creating a significant discrepancy with the actual field of view. For example, this can cause problems in games, such as a loss of realism and immersion.

[0007] Therefore, an object of the present invention is to provide an aerial image display device that can implement a concave curved aerial display that can achieve a more natural field of view.

[0008] In order to solve the above problem, an aerial image display device according to one aspect of the present invention comprises a display device, a control device that controls the output of a video signal to the display device, and an optical plate that is held facing the display screen of the display device at a predetermined angle, and is characterized in that when an image is displayed on the display device, the image is focused as an aerial image at a symmetrical position on the opposite side of the optical plate, and the display screen of the display device is curved, and as a result, the display surface of the aerial image is also curved.

[0009] In one embodiment, the display screen of the display device is convex, and as a result, the display surface of the aerial image is concave.

[0010] Furthermore, in one embodiment, the present invention is characterized in that it is implemented as a video display device for a flight simulator that simulates a cockpit.

[0011] Furthermore, in one embodiment, the cockpit is a cockpit of an aircraft, according to claim 2.

[0012] The floating image display device according to the present invention can realize a concave curved floating display that is not affected by external light.

[0013] FIG. 1 is a perspective view showing a flight simulator 1 using an aerial image display device according to a first embodiment of the present invention. FIG. 2 is a diagram illustrating the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the optical plate 40 in a flight simulator using the aerial image display device according to the first embodiment of the present invention, showing only the optical plate 40, the display screen of the curved display 20, and the aerial image G of the flight simulator 1 of FIG. 1 as viewed from the left side of the flight simulator 1. FIG. 3 is a diagram illustrating the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the optical plate 40 in a flight simulator using the aerial image display device according to the first embodiment of the present invention, showing only the optical plate 40, the display screen of the curved display 20, and the aerial image G of the flight simulator 1 of FIG. 1 as viewed from directly above the flight simulator 1. FIG. 4 is a diagram illustrating the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the optical plate 40 in a flight simulator using the aerial image display device according to Example 1 of the present invention, and shows only the optical plate 40, the display screen of the curved display 20, and the aerial image G of the flight simulator 1 of FIG. 1 as viewed from the front of the flight simulator 1. FIG. 5 is a perspective view showing a flight simulator 2 using the aerial image display device according to Example 2 of the present invention. FIG. 6 is a diagram illustrating the principle by which the display screen of the curved display 64 is imaged as an aerial image G by the optical plate 40 in a flight simulator using the aerial image display device according to Example 2 of the present invention, and shows only the optical plate 40, the display screen of the curved display 64, and the aerial image G of the flight simulator 2 of FIG. 5 as viewed from directly above the flight simulator 2. Figure 7 is a diagram explaining the principle by which the display screen of the curved display 64 is imaged as an aerial image G by the optical plate 40 in a flight simulator using an aerial image display device according to Example 2 of the present invention, and shows only the optical plate 40, the display screen of the curved display 64, and the aerial image G of the flight simulator 2 in Figure 5 as viewed from the front of the flight simulator 2.FIG. 8 is a perspective view showing a flight simulator 3 using an aerial image display device according to a third embodiment of the present invention. FIG. 9 is a diagram illustrating the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the beam splitter 40' and retroreflector 72 in a flight simulator using the aerial image display device according to the third embodiment of the present invention, showing only the beam splitter 40', retroreflector 72, display screen of the curved display 20, and the aerial image G of the flight simulator 3 as viewed from the left side of the flight simulator 3. FIG. 10 is a diagram illustrating the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the beam splitter 40' and retroreflector 72 in a flight simulator using the aerial image display device according to the third embodiment of the present invention, showing only the beam splitter 40', retroreflector 72, display screen of the curved display 20, and the aerial image G of the flight simulator 3 of FIG. 8 as viewed from directly above the flight simulator 1. Figure 11 is a diagram explaining the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the beam splitter 40' and the retroreflector 72 in a flight simulator using an aerial image display device according to Example 3 of the present invention, and shows only the beam splitter 40', the retroreflector 72, the display screen of the curved display 20, and the aerial image G of the flight simulator 3 in Figure 8 as viewed from the front of the flight simulator 1.

[0014] Hereinafter, a first embodiment of the aerial image display device according to the present invention will be described with reference to the accompanying drawings. In this example, the device is applied to a flight simulator, where a person can sit in a cockpit that mimics the real thing and operate an aircraft while watching images, thereby experiencing full-scale piloting. Flight simulators can be implemented as entertainment game consoles or as facilities for piloting training before actually flying an aircraft or the like.

[0015] 1, this flight simulator 1 is a pilot's seat simulating the cockpit of an aircraft, and is made up of a simulator main body 10 and a seat 17 for the pilot who operates this flight simulator 1. The simulator main body 10 is equipped with a control stick 12, control pedals 14, instruments 16, a speaker 18, etc.

[0016] Mounted inside the simulator body 10 are a curved display 20, a control device 30, and an optical plate 40. The control device 30 is connected to the control stick 12, control pedals 14, instruments 16, speakers 18, and curved display 20 via internal wiring (not shown), and exchanges signals with these devices to simulate flight conditions for the flight experience.

[0017] Optical plate 40 faces the display surface of curved display 20 at a certain angle (for example, 45 degrees) with the incident surface facing downward. The image on the display surface of curved display 20 is then re-focused as aerial image G at a position on the opposite side at the same distance, forming the same image as the original. In other words, aerial image G is displayed in a symmetrical position with respect to optical plate 40. Of course, the image displayed on curved display 20 is a flight image generated by flight simulator 1. The sound output from speaker 18 includes sound effects accompanying the pilot's control operations.

[0018] The specific implementation of the operation method, signal control, flight maneuver simulation, etc. performed by the flight simulator 1 here is the same as that of conventional flight simulators, so a detailed explanation will be omitted here.

[0019] The curved display 20 is a curved liquid crystal display device with a convex surface that is placed almost horizontally with the display surface facing upward. Here, the curvature of the convex surface is, for example, 1000R. Instead of a curved liquid crystal display device, a flexible display such as an organic EL display or backlit electronic paper may be curved to the desired curvature. In either case, it is important that the display surface is convex upward.

[0020] Here, the position of curved display 20 is fixed, but the support structure may be designed so that the position can be adjusted in the vertical direction. In this case, the focusing position of aerial image G can be adjusted to a position that is easy for the pilot to see.

[0021] The control device 30 is essentially a small computer and is composed of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a storage device for storing various programs and data, an input / output interface, etc. Examples of the input / output interface include a USB port and a wireless LAN such as WIFI. Various data related to the flight simulation and program updates can be performed via this input / output interface. The control device 30 then outputs a video signal to the curved display 20, which displays the aerial image. The control device 30 also outputs an audio signal to the speaker 18, which generates voice guidance, sound effects, etc.

[0022] The optical plate 40 may be, for example, an optical imaging element (two-sided orthogonal reflector) as described in Japanese Patent Laid-Open Publication No. 2011-175297. This optical imaging element is realized by arranging a large number of mutually orthogonal planar light reflecting portions at a fixed pitch. Alternatively, a structure such as a two-sided corner reflector, in which reflective surfaces are formed on the side surfaces of a square hole as described in Japanese Patent No. 4900618, may be used.

[0023] Figure 2 is a diagram explaining the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the optical plate 40. For simplicity of explanation, only the optical plate 40 of the flight simulator 1 in Figure 1, the display screen of the curved display 20, and the aerial image G are shown as seen from the left side of the flight simulator 1.

[0024] Figure 3 also explains the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the optical plate 40, and for the sake of simplicity, only the optical plate 40 of the flight simulator 1 in Figure 1, the display screen of the curved display 20, and the aerial image G are shown as a view from directly above the flight simulator 1.

[0025] Furthermore, Figure 4 is also a diagram explaining the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the optical plate 40, and for the sake of simplicity, only the optical plate 40 of the flight simulator 1 in Figure 1, the display screen of the curved display 20, and the aerial image G are shown as seen from the front of the flight simulator 1 (behind the seat 17 in Figure 1).

[0026] Under certain conditions of incident light, optical plate 40 with a dual reflection structure such as a two-sided orthogonal reflector or a two-sided corner reflector retroreflects incident light in the direction of the panel plane without changing the component of the incident light orthogonal to the panel plane. As a result, the display screen of curved display 20 and aerial image G are plane-symmetric with respect to optical plate 40.

[0027] That is, position L1 (the most convex position) at the horizontal center of the curved display 20 is closest to the optical plate 40, and light emitted from position L1 is focused at position M1 closest to the optical plate 40. In other words, light emitted from position L1 is reflected at arbitrary positions R1, R1 on the optical plate 40, and focused at position M1 on the opposite side of the optical plate 40, a distance equal to the distance between position L1 and the optical plate 40.

[0028] Similarly, position L2 on the outer side in the lateral direction of the curved display 20 is distant from the optical plate 40, and light emitted from position L2 is collected at position M2 distant from the optical plate 40. In other words, light emitted from position L2 is reflected at arbitrary positions R2, R2 on the optical plate 40, and collected at position M2 on the opposite side of the optical plate 40, a distance equal to the distance between position L2 and the optical plate 40.

[0029] As a result, from the perspective of the pilot sitting in seat 17, the aerial image G displayed in front of him / her appears to be curved concavely, and a concave curved aerial display is implemented.

[0030] In flight simulators using conventional flat displays, the left and right edges of the display are far from the eyes, making them difficult to see, and the image is distorted at the edges, resulting in a significant discrepancy from the actual field of view.In contrast, this concave curved aerial display can seamlessly reproduce the field of view seen by the pilot during an actual flight.

[0031] In addition, since there is no physical display in the air, the air display gives a three-dimensional feel, allowing for a more realistic piloting experience. Furthermore, with physical displays, the reflection of external light on the display surface can inevitably obstruct the pilot's view, but with the air display, such reflection of external light is not possible, allowing for a deeply immersive experience in the simulated piloting experience without being disturbed by external light. Entertainment

[0032] Next, a second embodiment of the aerial image display device according to the present invention will be described. This second embodiment is also applied to a flight simulator, in which a person can sit in a cockpit that mimics the real thing, operate the aircraft while watching images, and experience full-scale piloting. However, in this case, the curved display 20 is replaced with a combination of multiple flat displays. The rest of the configuration of the flight simulator is the same as that of the first embodiment shown in Figure 1, so a duplicated description will be omitted.

[0033] Figure 5 is a perspective view showing a flight simulator equipped with an aerial image display device according to a second embodiment of the present invention, and the same components as those in the first embodiment shown in Figure 1 are given the same reference numerals. That is, as shown in Figure 5, this flight simulator 2 has a pilot's seat simulating the cockpit of an aircraft, and is made up of a simulator main body 60 and a seat 17 for the pilot who pilots this flight simulator 2. The simulator main body 60 is equipped with a control stick 12, control pedals 14, instruments 16, a speaker 18, etc.

[0034] Similar to Example 1 shown in Figure 1, a display 64, a control device 30, and an optical plate 40 are mounted inside the simulator body 60, but the display 64 is not an integrated curved display as used in Example 1, but is composed of a combination of multiple flat displays 64-1, 64-2, and 64-3, as will be described later.

[0035] Here too, the control device 30 is connected to the control stick 12, control pedals 14, instruments 16, speakers 18 and display 64 via internal wiring (not shown), and exchanges signals with these to simulate flight conditions for the flight experience.

[0036] The optical plate 40 faces the display surface of the display 64 at a fixed angle (for example, 45 degrees) with the incident surface facing downward. The image on the display surface of the display 64 is then focused again as aerial image G at a position on the opposite side at the same distance, forming the same image as the original. In other words, the aerial image G is displayed in a symmetrical position with respect to the optical plate 40. The image displayed on the display 64 is a flight image generated by the flight simulator 2. The sound output from the speaker 18 includes sound effects accompanying the pilot's control operations.

[0037] The specific implementation of the operation method, signal control, flight maneuver simulation, etc. performed by the flight simulator 1 here is the same as that of conventional flight simulators, so a detailed explanation will be omitted here.

[0038] Figures 6 and 7 correspond to Figures 3 and 4 of Example 1, and are figures explaining the principle by which the display screen of the display 64 is imaged as an aerial image G by the optical plate 40. As with Figures 3 and 4, for the sake of simplicity, only the optical plate 40, the display screen of the display 64, and the aerial image G of the flight simulator 2 in Figure 5 are shown as views from directly above and in front of the flight simulator 2, respectively.

[0039] 7, the display 64 is made up of a central flat display 64-2 placed almost horizontally with its display surface facing upward, and flat displays 64-1 and 64-3 placed closely to the left and right of it at a certain angle (for example, 20 degrees). Therefore, if the display surfaces of the flat displays 64-1, 64-2, and 64-3 are considered to be a continuous series of display surfaces, the display 64 can be considered a curved display in a broad sense.

[0040] Again, the position of the display 64 is fixed, but the support structure may be designed so that the position can be adjusted vertically. In this case, the focusing position of the aerial image G can be adjusted to a position that is easy for the pilot to see.

[0041] The configurations, operations, and functions of the control device 30 and optical plate 40 are the same as those of the flight simulator 1 of the above-described first embodiment. As a result, the display screen of the curved display 64 and the aerial image G are plane-symmetrical with respect to the optical plate 40. Therefore, as in the above-described first embodiment, the aerial image G displayed in front of the pilot sitting in the seat 17 appears to be curved on a concave surface, and a concave aerial display is implemented.

[0042] The flight simulator 1 of Example 1 can seamlessly display a concave curved aerial image, but requires a dedicated curved display, which can be costly.The flight simulator 2 of Example 2 can be implemented by combining it with an inexpensive general-purpose liquid crystal display, which can reduce manufacturing costs.

[0043] Next, we will explain Example 3 of the aerial image display device according to the present invention. This Example 3 is also applied to a flight simulator, where a person can sit in a cockpit that mimics the real thing and operate the aircraft while watching the image, allowing them to experience full-scale piloting. However, in this example, a beam splitter is used as the optical plate, and the aerial image is realized using a retroreflection method in which a retroreflector is installed that retroreflects the light emitted from the curved display and reflected by the beam splitter.

[0044] Therefore, the difference from the first embodiment is that the optical system uses a retroreflection system using a beam splitter and a retroreflector, rather than an optical plate with a double reflection structure such as a two-sided orthogonal reflector or a two-sided corner reflector. The rest of the configuration of the flight simulator is the same as that of the first embodiment shown in Figure 1, so a duplicated explanation will be omitted.

[0045] Figure 8 is a perspective view showing a flight simulator equipped with an aerial image display device according to a third embodiment of the present invention, and the same components as those in the first embodiment shown in Figure 1 are designated by the same reference numerals. That is, as shown in Figure 8, this flight simulator 3 has a pilot's seat simulating the cockpit of an aircraft, and is made up of a simulator main body 70 and a seat 17 for the pilot who pilots the flight simulator. The simulator main body 70 is equipped with a control stick 12, control pedals 14, instruments 16, a speaker 18, etc.

[0046] Figures 9, 10 and 11 are diagrams explaining the principle by which the display screen of the curved display 20 is imaged as an aerial image G by the beam splitter 40' and the retroreflector 72. As with Figures 2, 3 and 4, for the sake of simplicity, only the optical plate (beam splitter 40'), retroreflector 72, the display screen of the curved display 20 and the aerial image G of the flight simulator 2 in Figure 8 are shown as views from the left side, directly above and in front of the flight simulator 3, respectively.

[0047] As in Example 1 shown in Figure 1, the simulator body 70 is equipped with a curved display 20, a control device 30, and an optical plate, but a beam splitter 40' is used as the optical plate, and a retroreflector 72 is provided on the back side of the flight simulator 3.

[0048] As in Example 1, the curved display 20 is a curved liquid crystal display device with a convex display surface facing upward and placed approximately horizontally. Here, the curvature of the convex surface is, for example, 1000R. Instead of a curved liquid crystal display device, a flexible display such as an organic EL display or backlit electronic paper may be curved to the desired curvature. In either case, it is important that the display surface is convex upward. Again, the position of the curved display 20 is fixed, but the support structure may be designed so that the position can be adjusted vertically. In this case, the focusing position of the aerial image G can be adjusted to a position that is easy for the pilot to see.

[0049] Here too, the control device 30 is connected to the control stick 12, control pedals 14, instruments 16, and speakers 18 via internal wiring (not shown), and exchanges signals with these to simulate flight conditions for the flight experience.

[0050] Beam splitter 40' has its incident surface facing downward and faces the display surface of curved display 20 at a certain angle (for example, 45 degrees). Light from curved display 20 is reflected by beam splitter 40' and retroreflected by retroreflector 72, which is provided on the opposite side of beam splitter 40' when viewed from aerial image G. In other words, the incident direction and reflected direction of light at retroreflector 72 are the same but opposite.

[0051] The light retroreflected by the retroreflector 72 passes through the beam splitter 40′ and is focused as an aerial image G. Again, the display screen of the curved display 20 and the aerial image G are plane-symmetric with respect to the optical plate (beam splitter 40′), so a concave curved aerial display is implemented.

[0052] That is, the image on the display surface of curved display 20 is re-focused as aerial image G on the opposite side at the same distance to form the same image as the original. That is, aerial image G is displayed in a symmetrical position with respect to beam splitter 40'. The image displayed on curved display 20 is a flight image generated by flight simulator 3. The sound output from speaker 18 is sound effects accompanying the pilot's control operations.

[0053] The specific implementation of the operation method, signal control, flight maneuver simulation, etc. performed by the flight simulator 1 here is the same as that of conventional flight simulators, so a detailed explanation will be omitted here.

[0054] Again, the position of the curved display 20 is fixed, but the support structure may be designed so that the position can be adjusted in the vertical direction. In this case, the focusing position of the aerial image G can be adjusted to a position that is easy for the pilot to see.

[0055] The configurations, operations, and functions of control device 30 and curved display 20 are similar to those of flight simulator 1 in the above-described embodiment 1. The display screen of curved display 20 and aerial image G are plane-symmetrical with respect to beam splitter 40', and therefore, similar to the above-described embodiment 1, from the perspective of the pilot sitting in seat 17, the aerial image G displayed in front of him appears to be curved concavely, providing a natural field of view.

[0056] This flight simulator 3 employs a retroreflective system, and therefore the brightness of the aerial image G is lower than that of flight simulators 1 and 2, which employ the double reflection structure of Examples 1 and 2. However, it has the advantage of having a wide viewing angle characteristic, making it easy to design a relatively large system.

[0057] The aerial image display device of the present invention makes it possible to realize a concave curved aerial display, which can be used as a flight simulation game machine for entertainment or as equipment for pilot training before actually flying an aircraft, etc.

[0058] The above describes the aerial image display device according to the present invention based on an embodiment, but the present invention is not limited to this, and modifications may be made within the scope of the spirit of the present invention, and if possible, the techniques described in each embodiment may be combined, or publicly known techniques may be combined, etc.

[0059] For example, typical aerial image display devices often incorporate a contactless interface that allows operation by touching the aerial image. Because the above embodiment simulates a cockpit, such a contactless interface is omitted. However, depending on the application, a contactless interface that allows operation by touching the aerial image can function very effectively. In such cases, a contactless interface can be implemented by providing an operation detection unit consisting of an infrared LED and an infrared camera near the aerial image (e.g., on the front side of the optical plate 40), similar to conventional aerial image display devices.

[0060] 1, 2, 3 Flight simulator 10, 60, 70 Simulator body 12 Control stick 14 Control pedals 16 Instruments 17 Seat 18 Speaker 20, 64 Curved display 30 Control device 40 Optical plate 40' Beam splitter 64-1, 64-2, 64-3 Flat display 72 Retroreflector

Claims

1. A display device; a control device for outputting a video signal to the display device; an optical plate held facing a display screen of the display device at a predetermined angle; When an image is displayed on the display device, the image is formed as an aerial image at a symmetrical position on the opposite side of the optical plate, The display screen of the display device is constructed by combining multiple flat displays, and is a convex display screen as a whole, so that the display surface of the aerial image is concave as a whole.

2. An aerial video display device as described in Claim 1, characterized in that the multiple flat displays consist of a central flat display and a pair of flat displays on the left and right sides of the central flat display, closely spaced at a certain angle.

3. 3. The aerial image display device according to claim 2, which is implemented as an image display device for a flight simulator simulating a cockpit.

4. 4. The aerial image display device according to claim 3, wherein the cockpit is a cockpit of an aircraft.