Display device and method for display

Abstract

To provide a technique of displaying an aerial image in a distant view of a large screen.SOLUTION: In an embodiment of the present invention, the position of the point of view of an observer is between an aerial image which is presented by a presentation device for presenting an image and is formed in the air and the presentation device. The display device according to the embodiment of the present invention has a parallax compensation image generation unit for generating a presentation image to present by the presentation device by compensating the parallax of images for the right eye and for the left eye to display, on the basis of the distance from the position of the point of view and the aerial image and the parallax of an observer.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a display device and a display method. [Background technology]

[0002] As a device for presenting floating images, a method for displaying an aerial image using a retroreflective material and a half mirror (Prior Art Document 1) and a method for presenting a distant floating image by making the display see-through and allowing the viewer to observe from the other side (Prior Art Document 2) have been proposed. Such devices can display 2D or 3D aerial images corresponding to the display used, or a see-through display superimposed on a distant view. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Hirotsugu Yamamoto, "Aerial Display Using Aerial Imaging by Retroreflection (AIRR)", Journal of the Imaging Society of Japan, Vol. 56, No. 4: 341-351, 2017 [Non-Patent Document 2] Kengo Fujii, Department of Systems Innovation Engineering, Graduate School of Engineering, Utsunomiya University, PhD thesis, "Research on multi-functionalization of aerial display optical systems using aerial imaging by retroreflection," 2020 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the size of the displayed image is the same as the size of the display screen even when it is floated far away, so there was a problem that the apparent size would be small when presented at a distance. In view of the above circumstances, an object of the present invention is to provide a technique that makes it possible to display a distant aerial image on a large screen. [Means for solving the problem]

[0005] One aspect of the present invention is a display device in which the viewpoint position of an observer is between an aerial image presented by a presentation device that presents an image and formed in the air, and the display device includes a parallax compensation image generation unit that performs parallax compensation for images for the left and right eyes to be displayed based on the distance from the viewpoint position to the aerial image and the parallax of the observer, thereby generating a presentation image to be presented by the presentation device.

[0006] One aspect of the present invention is a display method in which an observer's viewpoint position is between an aerial image that is presented by a presentation device and formed in the air by the presentation device, and a presentation image to be presented by the presentation device is generated by performing parallax compensation on images to be displayed for the left and right eyes based on the distance from the viewpoint position to the aerial image and the parallax of the observer, and the generated image is presented by the presentation device. Effect of the Invention

[0007] The present invention makes it possible to display a distant aerial image on a large screen. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a display device according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram for explaining a display method according to an embodiment. [Diagram 3] FIG. 3 is an explanatory diagram showing the parallax of an image displayed under the conditions of FIG. 2. [Figure 4] 1A and 1B are diagrams illustrating examples of images generated by an image generating device according to an embodiment. [Diagram 5] 11 is a flowchart of a processing procedure for generating a parallax image according to an embodiment. [Figure 6] 13A to 13C are diagrams showing a configuration example and images of a second modified example. [Figure 7] FIG. 13 is a diagram showing an example of the configuration of a display device according to second and fourth modified examples. [Figure 8] FIG. 13 is a diagram illustrating a configuration example of a fifth modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described in detail with reference to the drawings. 1 is a diagram showing an example of the configuration of a display device according to the present embodiment. As shown in FIG. 1, the display device 1 includes an image generating device 2 and a presentation device 3. The image generating device 2 includes, for example, an acquisition unit 21, a parallax-compensated image generating unit 22, and an output unit . The presentation device 3 includes, for example, a display 31 , a half mirror 32 , and a reflecting material 33 .

[0010] The image generating device 2 and the presentation device 3 may be connected by wire or wirelessly. The presentation device 3 may be, for example, two, one for each of the left and right eyes, or may be an integrated type.

[0011] The acquisition unit 21 acquires an image to be displayed.

[0012] The parallax-compensated image generating unit 22 generates a parallax-compensated image using the acquired image.

[0013] The generated image is outputted to the output unit 23. Note that the image signal may be a still image, a series of still images, or a moving image.

[0014] The display 31 is, for example, a shutter glasses type 3D display device.

[0015] The half mirror 32 transmits and reflects a certain ratio of light from the display 31. The half mirror 32 is disposed at an angle so as to reflect the light from the display 31, as shown in FIG.

[0016] The reflector 33 is, for example, a retroreflective material that retroreflects light in the same trajectory as the light entered, regardless of the direction from which the light strikes it. The display 31 and the reflector 33 are arranged in parallel. For information on aerial imaging by retroreflection, see Non-Patent Documents 1 and 2.

[0017] (Display method) FIG. 2 is a schematic diagram for explaining the display method of this embodiment. Note that FIG. 2 is a diagram seen from the top of the head of the observer (g31). Reference symbol g1 is an image signal output by the image generating device 2. Reference symbol g2 is display light from the display 31. Arrow g3 represents the observation direction. Reference symbol g12 represents the image to be observed. The distance from the position of the observer's eyes to the observed image is L. Also, the distance from the position of the observer's eyes to the aerial image is -d. Also, reference symbol O is the position of the observer's line of sight. Note that the aerial image is an image formed in the air. In this embodiment, the observer observes from a position closer to the presentation device 3 than the aerial image presented by the presentation device 3. Also, as shown in FIG. 2, the position of the observer's eyes is such that the presentation device 3 is in front of the eyes and is between the aerial image presented by the presentation device 3 and the presentation device 3.

[0018] The configuration of the presentation device part is a display system for a floating image by a conventional AIRR (Aerial Imaging by Retro-Regulation), and an aerial image of the display image is displayed. In this embodiment, unlike the conventional AIRR, it is assumed that the aerial image (g11) is observed at a position closer to the half mirror 32. The observer wears and uses the presentation device 3 including the display 31. This allows the observer to observe different images with the left and right eyes in this embodiment. In this embodiment, the observation position is set by placing, for example, a chair (not shown) at the observation position so that the observer can observe the image from a position closer to the half mirror 32 than the aerial image.

[0019] Fig. 3 is an explanatory diagram showing the parallax of an image displayed under the conditions of Fig. 2. The horizontal axis shows the observer's viewpoint position relative to the position of the aerial image. The negative value side is the observer's pupil position assumed in this embodiment. The vertical axis shows the parallax. 0 means infinity, and positive values ​​indicate the case closer than infinity.

[0020] FIG. 4 is a diagram showing an example of an image generated by the image generating device of this embodiment. Image g101 is an image for the right eye acquired by the image generating device 2. Image g102 is an image for the left eye acquired by the image generating device 2. Image g111 is an image obtained by rotating image g101 by 180° and inverting it by the parallax compensation image generating unit 22. Image g112 is an image obtained by rotating image g102 by 180° in the vertical direction of the observer and inverting it by the parallax compensation image generating unit 22. Image g121 is an image for the right eye before it is moved inward, and image g122 is an image for the right eye after it is moved inward. Image g123 is an image for the left eye before it is moved inward, and image g124 is an image for the left eye after it is moved inward.

[0021] The assumed distance of the observer in this embodiment is a condition where the parallax is negative, and therefore the optical axes of both eyes are dispersing, and stable binocular vision is not possible. The optical axes of both eyes are diverging from the parallel angle θ=tan -1 The distance is (PD / 2d), where PD is the interpupillary distance of the observer. For this reason, the parallax-compensated image generating unit 22 moves the images displayed, such as images g121 to g124 in FIG. 4, a distance d tan θ inward, allowing an enlarged image to be observed at infinity when viewed with both eyes. Note that "inward" means that the image for the left eye is moved to the right (images gg123, g124 in FIG. 4) and the image presented to the right eye is moved to the left (images gg121, g122 in FIG. 4). Furthermore, if a correction amount is added, the image can be observed closer by the amount of the added parallax.

[0022] The viewing angle of the displayed image is 2tan -1 (L / 2d). When d is 0, it is infinite, and when d is large, it decreases. In addition, compared to a normal floating image, the displayed image rotates 180 degrees, so in this embodiment, the presentation device 3 or the image is rotated as necessary.

[0023] The display 31 may be, for example, any one of a shutter glasses type 3D display device, a 2D display, and a naked-eye 3D display device. When the display 31 is a glasses-type 3D display device, the parallax-compensated image generating unit 22 compensates for parallax by shifting both predetermined images inward, as described above. When the display 31 is a 2D display, a stereogram with a predetermined amount of parallax is displayed on the display 31. When the display 31 is a naked-eye 3D display device, the parallax-compensated image generating unit 22 shifts the directional image inward by a predetermined amount to compensate for parallax.

[0024] (Image Generation Method) 5 is a flowchart of a processing procedure for generating parallax images according to this embodiment. Note that the following processing is an example of a processing for rotating an image by 180 degrees.

[0025] (Step S1) The acquisition unit 21 acquires images for the left and right eyes to be presented to the observer. If the acquired images are the same for the left and right eyes, they become 2D images floating at a predetermined distance, and if the acquired images are stereoscopic images that can be viewed stereoscopically by the left and right eyes, they become three-dimensional images floating at a predetermined distance so that the positions where the images for the left and right eyes overlap are different.

[0026] (Step S2) The parallax-compensated image generating unit 22 rotates the acquired left and right eye images by 180° and inverts them.

[0027] (Step S3) The parallax-compensated image generating unit 22 shifts each of the inverted images inward by an angle δ in the following equation (1).

[0028]

number

[0029] (Step S4) The output unit 23 outputs the left and right eye images generated by the parallax-compensated image generating unit 22 in the processes of steps S2 and S3.

[0030] The above-described processing procedure is merely an example, and is not limiting. For example, the processing in steps S2 and S3 may be performed simultaneously, or the processing procedures may be reversed. By repeating the above-mentioned process, the display device 1 can also display moving images.

[0031] (evaluation) When multiple observers were asked to view the image corrected as described above, all observers were able to stably view the distant floating image. That is, according to the configuration of this embodiment, an unprecedented effect of displaying a distant aerial image on a large screen could be obtained using an optical system that is inexpensive and does not require special installation accuracy, consisting of a general-sized display, a half mirror 32, and a reflecting material 33. The general-sized display is the display 31.

[0032] Furthermore, when the observer moved his / her head left or right while sitting in the seat, the aerial image moved in the same direction by a greater distance than the amount of movement of the observer's head. The range in which the aerial image is visible is limited by the width of the half mirror 32. However, according to the configuration of this embodiment, when the observer moves his / her head to view the part cut off by the half mirror 32, he / she can see a wider range than if he / she performed the same movement in real space. The way this embodiment presents images, which is not possible with conventional aerial image presentation, can provide a new advantage in applications where understanding the space of the displayed image is important, such as games and the metaverse, where the viewer can see a wide range by simply moving their head slightly, even while remaining confined to their seat.

[0033] As described above, in the display device 1 configured in this manner, the presentation device 3 and the observation position are limited, and the image generating device displays an image with parallax compensation, making it possible to display aerial images of distant views on a large screen.

[0034] (First Modification) In the first modification, instead of the glasses-type two-eye 3D display, for example, a light field display or a multi-eye or two-eye naked-eye 3D display may be used to display different images depending on the position of the observer's pupils. Note that a light field display is a display device that realizes stereoscopic vision by reproducing light reflected from a material on the display. The configuration of the first modification provides the same effect as the above-mentioned embodiment.

[0035] (Second Modification) Fig. 6 is a diagram showing a configuration example of the second modified example and each image. Fig. 7 is a diagram showing a configuration example of the display device of the second and fourth modified examples. As shown in Fig. 7, the display device 1A includes an image generating device 2 and a presentation device 3A. The presentation device 3A includes, for example, a display 31, a half mirror 32, a reflecting material 33, a fixing unit , an adjustment mechanism 35, a control unit , an operation unit 37, and a head position detection unit .

[0036] The adjustment mechanism 35 includes, for example, a gear, a motor, etc. The adjustment mechanism 35 adjusts the position, length, angle, etc. of the fixing part 34 under the control of the control part 36.

[0037] The control unit 36 ​​controls the position, angle, length, etc. of the fixing unit 34 via the adjustment mechanism 35 according to the operation result of the operating unit 37 or the detection result of the head position detection unit 38.

[0038] The operation unit 37 detects the result of an operation by the observer. The operation unit 37 is, for example, a touch panel sensor, a mechanical switch, or the like.

[0039] The head position detector 38 detects the head position of the viewer.

[0040] The fixing unit 34 is for fixing the presentation device 3A (3-1A, 3-2A) and the observer (g31), and may be, for example, something like the temples or nose pads of glasses. The fixing unit 34 is configured so that the length, etc. of the fixing unit 34 can be changed by the adjustment mechanism 35 and the control unit 36 ​​so that the observation position is at a predetermined distance, and may be moved manually or by the adjustment mechanism 35 in response to the result of the observer operating the operation unit 37. Furthermore, the symbol g211 is an aerial image in the right eye, and the symbol g12 is an aerial image in the left eye. The symbol g213 is an image to be observed.

[0041] As shown in Fig. 6, a presentation device 3A (3-1A, 3-2A) may be used for each of the left and right eyes. In such a configuration, the image generating device 2 shifts and compensates for the parallax between the images for the left and right eyes so that the images for the left and right eyes overlap exactly at the position of the observed image (g213). Moreover, the compensation may be performed by shifting the positions of the presentation devices 3A for the left and right eyes to the left or right, rather than by changing the position of the displayed image.

[0042] In the display device configured in this manner, the positional relationship between the viewer's line of sight and the presentation device 3A can be appropriately fixed, so that the positional relationship between the viewer's line of sight and the presentation device 3A can be appropriately set.

[0043] (Third Modification) Alternatively, a 2D display may be used as display 31, and parallax-compensated image generating unit 22 may display a stereogram having a parallax equivalent to the compensated parallax. The stereogram may be, for example, a random dot stereogram, a color field stereogram, etc. When the display image is small, multi-view images arranged at intervals of the amount of parallax to be compensated may be displayed.

[0044] In a display device configured in this manner, a 2D display is used as the display 31, making it possible to display a distant aerial image on a large screen.

[0045] (Fourth Modification) In addition, although an example of using a chair as an example of a means for restricting the observation position has been described, a fence or wall may be provided behind the chair, or a line indicating the standing position may be used. Furthermore, the presentation device 3 may display an image on the display 31 only when the observation position is closer to the half mirror than the aerial image based on the result detected by the head position detection unit 38. Alternatively, when the detected head position is farther away from the aerial image, the presentation device 3 may move the position of the display 31 away from the half mirror to move the position of the aerial image away and obtain an effect equivalent to that of the observation position restriction means (chair, fence, wall, etc.). In this case, the control unit 36 ​​may control the position and angle of the display 31 by using the adjustment mechanism 35, such as the length and angle of the fixing unit 34. Note that the image generation device 2 may include the control unit 36. In this case, the result detected by the head position detection unit 38 may be transmitted to the image generation device 2, and the image generation device 2 may generate a control value for the adjustment mechanism 35 based on the detection result, and transmit the generated control data to the presentation device 3A.

[0046] In a display device configured in this manner, the control unit 36 ​​controls the position and angle of the display 31 using the adjustment mechanism 35, such as the length and angle of the fixing unit 34, thereby making it possible to appropriately adjust the positional relationship between the observer's line of sight and the presentation device 3A.

[0047] (Fifth Modification) In addition, as shown in FIG. 8, by providing a Fresnel lens 22A in front of the display device, The parallax may be compensated for. Fig. 8 is a diagram showing a configuration example of the fifth modified example. In the fifth modified example, a concave Fresnel lens 22A is installed so that the focal position is the position of the aerial image, thereby allowing the user to perceive a floating image at infinity. The Fresnel lens 22A may be included in the presentation device 3. In this modified example, the concave Fresnel lens 22A compensates for parallax. Therefore, the concave Fresnel lens 22A corresponds to the parallax-compensated image generation unit 22.

[0048] In the display device configured in this manner, since the Fresnel lens 22A, which is a concave lens, is used as the parallax compensation image generating section, it becomes possible to display a distant aerial image on a large screen.

[0049] (Sixth Modification) In the above example, an example of using an AIRR as a display mechanism for a floating image has been described, but this is not limited to this. The presentation device 3 may be generated and displayed using, for example, a parity mirror, a corner reflector array such as a plate that reflects light emitted and diffused from an object twice with a micromirror in the plate and forms a real image in the air, or a lens system. In this case, the same effect can be obtained with the aerial image displayed in this way.

[0050] The parallax compensation image generating unit 22 of the image generating device 2 and the control unit 36 ​​of the presentation device 3A are configured using a processor such as a CPU (Central Processing Unit) and a memory. The parallax compensation image generating unit 22 functions as the above-mentioned functional unit by the processor executing a program. The control unit 36 ​​functions as the above-mentioned functional unit by the processor executing a program. All or part of the functions of the parallax compensation image generating unit 22 or the control unit 36 ​​may be realized using hardware such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The above-mentioned program may be recorded on a computer-readable recording medium. The computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a semiconductor storage device (for example, an SSD: Solid State Drive), or a storage device such as a hard disk or a semiconductor storage device built into a computer system. The above-mentioned program may be transmitted via an electric communication line.

[0051] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and designs that do not deviate from the gist of the present invention are also included. [Industrial Applicability]

[0052] The present invention is applicable to floating image display systems, aerial image display systems, aerial displays, game systems, systems using virtual spaces, and the like. [Explanation of symbols]

[0053] 1, 1A... display device, 2, 2A... image generating device, 3... presentation device, 21... acquisition unit, 22... parallax compensation image generating unit, 23... output unit, 31... display, 32... half mirror, 33... reflecting material, 34... fixing unit, 35... adjustment mechanism, 36... control unit, 37... operation unit, 38... head position detection unit, 22A... Fresnel lens

Claims

1. a viewpoint position of an observer is between an aerial image that is presented by a presentation device and formed in the air, and the presentation device; a parallax-compensated image generating unit that performs parallax compensation for images for the left and right eyes to be displayed based on a distance from the viewpoint position to the aerial image and the parallax of the observer, to generate a presentation image to be presented by the presentation device; A display device comprising:

2. The parallax-compensated image generating unit performing the parallax compensation by moving the images for the left and right eyes to be displayed closer to each other based on the distance from the viewpoint position to the aerial image and the parallax of the observer; The display device according to claim 1 .

3. The presentation device includes: a display that outputs the image output by the parallax compensation image generating unit as a light beam; a half mirror that reflects light from the display and is disposed between the display and a retroreflector and obliquely with respect to the display; A retroreflective material arranged parallel to the display and retroreflecting light from the half mirror; Equipped with The display is a glasses-type 3D display device, the parallax-compensated image generation unit compensates for parallax by shifting the positions of the images for the left and right eyes by a predetermined amount so as to bring them closer to each other; The display device according to claim 1 .

4. The presentation device includes: a display that outputs the image output by the parallax compensation image generating unit as a light beam; a half mirror that reflects light from the display and is disposed between the display and a retroreflector and obliquely with respect to the display; A retroreflective material arranged parallel to the display and retroreflecting light from the half mirror; Equipped with the display is a 2D display; the parallax-compensated image generating unit causes the display to display a stereogram with a predetermined amount of parallax; The display device according to claim 1 .

5. The presentation device includes: a display that outputs the image output by the parallax compensation image generating unit as a light beam; a half mirror that reflects light from the display and is disposed between the display and a retroreflector and obliquely with respect to the display; A retroreflective material arranged parallel to the display and retroreflecting light from the half mirror; Equipped with the display is a naked-eye 3D display device; the images for the left and right eyes are directional images, the parallax-compensated image generation unit compensates for parallax by shifting the directional images by a predetermined amount so as to bring them closer to each other. The display device according to claim 1 .

6. The presentation device includes: provided in front of the left and right eyes of the observer, a fixing unit that fixes the distance from the gaze position of the observer to a predetermined value; an adjustment mechanism capable of adjusting a distance from the line of sight of the observer; a head position detection unit for detecting a head position of the observer; a control unit that adjusts the distance from the eye position of the viewer by the adjustment mechanism based on a detection result detected by the head position detection unit; and Equipped with The display device according to claim 1 .

7. the parallax compensation image generation unit is a Fresnel lens that is a concave lens arranged between the observer and the presentation device; The display device according to claim 1 .

8. a viewpoint position of an observer is between an aerial image that is presented by a presentation device and formed in the air, and the presentation device; generating a presentation image to be presented by the presentation device by performing parallax compensation on images for the left and right eyes to be displayed based on a distance from the viewpoint position to the aerial image and a parallax of the observer; Displaying the generated image on the display device. Display method.

Images